Copilot comes on the scene, ChatGPT uses Bing search by default, and the big universe of Microsoft and OpenAI is here

Machine Heart Report

Heart of Machine Editorial Department

This year's Microsoft Build conference focused heavily on generative AI and teamed up with OpenAI to create a big universe.

In recent months, Microsoft has been busy building generative AI into many of its products and services, including its search engine Bing, browser Edge, GitHub and Office productivity suite.

At the Microsoft Build 2023 conference held early this morning, these results finally came out, and they went a step further: Microsoft's AI universe is becoming more and more complete.

The topic of this year’s Microsoft Build conference is highly focused on AI. Microsoft CEO Satya Nadella first discussed platform shifts and recalled technology changes over the years, and then went straight to the announcement: "We announced more than 50 updates for developers, from bringing Bing to ChatGPT to Windows Copilot to New Copilot Stack, Azure AI Studio, and new data analytics platform Microsoft Fabric with universal scalability."

Next, Microsoft released these important updates in succession. Changes more relevant to ordinary users include: the addition of CoPilot experience in Windows 11 and Edge, and the new Bing AI and Copilot plug-ins for OpenAI ChatGPT.

Copilot Login to Windows 11

This time Microsoft released Windows Copilot, becoming the first PC platform to provide users with centralized AI assistance. Windows Copilot works with Bing Chat and first/third-party plug-ins, allowing users to focus on bringing their ideas to life, completing complex projects, and collaborating instead of spending energy finding, launching, and working across multiple applications.

Windows Copilot is very simple to call and use. Once opened, Windows Copilot becomes a sidebar tool integrated into the operating system to help users complete various tasks.

Microsoft said that Windows Copilot will become a highly effective personal assistant, helping users take actions, customize settings and seamlessly link to their favorite applications.

In addition, many Windows features, including copy/paste, Snap Assist, screenshots, and personalization, can be made better through Windows Copilot. For example, users can not only copy/paste, but also ask Windows Copilot to rewrite, summarize, or explain the content.

Meanwhile, just like with Bing Chat, users can ask Windows Copilot a series of questions ranging from simple to complex. For example, if I want to call my family in Cyprus, I can quickly check the local time to make sure I don't wake them up in the middle of the night. If I want to plan a trip to Cyprus to visit them, I can ask Windows Copilot to look up flights and accommodation.

Microsoft said that Windows Copilot will begin public testing in June and will be gradually rolled out to existing Windows 11 users.

ChatGPT default Bing search

Since Bing announced access to ChatGPT, Bing users have participated in more than 500 million chats, created more than 200 million images using Bing Image Creator, and daily downloads of the Bing mobile app have increased by 8 since launch times.

At this conference, Bing ushered in three key updates: integrating Bing search into ChatGPT, establishing a common plug-in platform with OpenAI and new plug-in partners, and expanding Bing Chat’s presence across Microsoft Copilot Integrate.

"Today's updates create greater opportunities for developers and more amazing experiences for people as we continue to transform search."

One of the noteworthy changes is that Bing will become the default search engine plug-in for ChatGPT. Nadella also showed how it would work:

“This is just the beginning of our plans to work with our partners at OpenAI to bring the best of Bing into the ChatGPT experience,” Nadella said.

Microsoft said that after ChatGPT is connected to the new Bing, it can provide more timely and updated answers through network access. ChatGPT Plus subscribers can experience this feature immediately.

Default Bing search in ChatGPT

Accelerate building the Bing ecosystem and enhance performance with plug-ins

Microsoft and OpenAI will support and grow the AI ​​plug-in ecosystem through interoperability. This means developers can now use one platform to build and submit plug-ins for both consumer and enterprise, including ChatGPT, Bing, Dynamics 365 Copilot, Microsoft 365 Copilot and Windows Copilot.

As part of this shared plug-in platform, Bing is adding support for various plug-ins. In addition to the previously announced OpenTable and Wolfram Alpha add-ons, Microsoft has announced the addition of Expedia, Instacart, Kayak, Klarna, Redfin, TripAdvisor and Zillow to the Bing ecosystem.

With plug-ins built directly into the chat system, Bing will make relevant suggestions based on users' conversations. For example, users can use the OpenTable plug-in to ask about restaurants and other related topics. In addition, Microsoft also stated that such functions will be available in the Bing application on the mobile terminal, which will greatly expand application scenarios.

Additionally, dozens of businesses are becoming partners with the Bing Chat plugin:

Bing Plug-in

Meanwhile, developers can now use plug-ins to integrate their apps and services into Microsoft 365 Copilot. Plug-ins for Microsoft 365 Copilot include the ChatGPT and Bing plug-ins, as well as the Teams messaging extension and the Power Platform connector.

Integrate Bing into Copilot

At the same time, with the release of Windows Copilot, Microsoft has also integrated the powerful functions of Bing Chat into Windows 11. Working with Windows Copilot and Bing Chat, including a shared plug-in platform with Bing and OpenAI, will enable these plug-ins to be enhanced with apps on Windows. This will make it easier than ever to get personalized answers, relevant recommendations and take quick action.

In addition to Windows, Microsoft has also integrated its universal plug-in platform natively into the Edge browser, making it the first browser to integrate AI search.

Dev Home: Improving developer productivity on Windows 11

We know that developers are constantly dealing with manual development setups at work, not just frequent clicks but multiple tool logins, suboptimal navigation of file systems, and context switching. All of these can seriously impact their development efficiency.

Therefore, in order to improve developer productivity, Microsoft launched a new productivity partner Dev Home in Windows 11. A preview version of Dev Home is currently available, with WinGet configuration functionality for simpler and faster setup, Dev Drive functionality for enhanced file system functionality, and a new custom control panel for tracking all workflows and tasks in one place . These can simplify the developer's workflow.

Dev Home can easily link to GitHub to easily install the tools and packages you need.

Dev Home can also configure user coding environments on the cloud using Microsoft Dev Box and GitHub Codespaces. In summary, with Dev Home designed for developers, Microsoft provides the ultimate productivity partner, allowing them to focus on what they do best – writing code.

Dev home address:

https://github.com/microsoft/DevHome

WinGet configures unattended and reliable development machine settings

With the new WinGet configuration, developers can be ready to code in just a few clicks. This unattended, reliable and repeatable mechanism allows developers to skip the manual work of setting up a new machine or starting a new project, eliminating the hassle of downloading the correct versions of software, packages, tools and frameworks and applying settings. Setup time can be reduced from days to hours.

Dev Drive: New storage volumes tailored for developers

Users often encounter situations where they need to process repositories containing thousands of files and directories, which poses challenges for I/O operations such as builds. Now, Microsoft has launched Dev Drive, a new storage volume that combines performance and security features and is customized for developers.

Dev Drive is based on the Resilient File System and provides up to 30% file system improvements in build times for file I/O scenarios.

Dev Home makes setting up a Dev Drive during environment setup very simple. It's great for hosting project source code, working folders, and package cache. Microsoft will make Dev Drive available in preview later this week.

Efficiently track user workflow in Dev Home

Dev Home also helps users manage running projects by adding GitHub widgets to efficiently track all coding tasks or requests made, as well as track CPU and GPU performance. Additionally, Microsoft is working with Team Xbox to integrate GDK into Dev Home, making it easier to start creating games.

GitHub Copilot X powered Windows Terminal

GitHub Copilot users will be able to use natural language AI models to recommend commands, interpret errors, and take actions in the Terminal app through inline and experimental chat experiences.

In addition, Microsoft is also experimenting with AI functions supported by GitHub Copilot in developer tools such as WinDBG to help users improve work efficiency. The GitHub Copilot Chat waitlist is now open, and Microsoft will soon open access to these features.

Let every Windows 11 developer become an AI developer

In addition, Microsoft continues to invest in important tools to more democratize building applications for the new era of artificial intelligence. Whether you are developing on x86/x64 or Arm64, Microsoft wants to make it easy for users to bring AI-driven experiences to Windows applications in the cloud and edge computing.

Last year at Build, Microsoft announced a new development model, Hybrid Loop, that can implement hybrid AI scenarios across Azure and client devices. Likewise, at Build today, Microsoft said its vision has been realized. Using ONNX Runtime as the gateway for Windows AI and Olive, Microsoft has created a tool chain that reduces the burden on users when optimizing various Windows and other device models. With ONNX Runtime, third-party developers can access tools used internally by Microsoft to run AI models on Windows or other devices across CPU, GPU, NPU or hybrid with Azure.

When running models, ONNX Runtime now supports running the same API on the device or in the cloud, supporting hybrid inference scenarios. In addition, user applications can use local resources and switch to the cloud when needed. With the new Azure EP preview, users can connect to models deployed in AzureML and even to the Azure OpenAI service. With just a few lines of code, users can specify cloud endpoints and define criteria for when to use the cloud. As a result, users have greater control over costs because Azure EP gives users the flexibility to choose to use larger models in the cloud or use smaller on-premises models at runtime.

Users can also optimize models for different hardware using Olive, an extensible tool chain that combines cutting-edge technologies for model compression, optimization and compilation. Based on this, users can use ONNX Runtime across platforms such as Windows, iOS, Android and Linux.

To summarize, both ONNX Runtime and Olive help speed up the deployment of AI models into applications. ONNX Runtime makes it easier for users to create stunning AI experiences on Windows and other platforms while reducing engineering effort and increasing performance.

New features and experiences in the Microsoft Store

Microsoft has released a number of new features for the Microsoft Store, including those related to AI technology:

Microsoft Store AI Hub: This is a new feature that will be launched soon, and the developer community and Microsoft will work together to build the best AI experience;

AI-generated keywords: Microsoft has added a new tool to Partner Center that uses AI to generate keywords and search tags for apps in the Microsoft Store to improve the discoverability of these apps;

AI-generated review summaries: Microsoft uses AI technology to compile thousands of reviews into a simple summary, making it faster and easier for customers to understand user reviews and feedback on their apps.

The above is just the content of the keynote on the first day of the multi-day build developer conference, and more content will be released in the future.

We can see from this that Microsoft has joined forces with OpenAI to create an AI universe that will not only transform and upgrade its own products but also radiate and influence the entire technology community.

Perhaps this AI wave has just begun.

Reference link:

https://blogs.windows.com/windowsdeveloper/2023/05/23/bringing-the-power-of-ai-to-windows-11-unlocking-a-new-era-of-productivity-for -customers-and-developers-with-windows-copilot-and-dev-home/

The above is the detailed content of Copilot comes on the scene, ChatGPT uses Bing search by default, and the big universe of Microsoft and OpenAI is here. For more information, please follow other related articles on the PHP Chinese website!