Siri receives a major upgrade: it has screen awareness and can interact deeply with apps

Apple today released the newly upgraded Siri voice assistant at WWDC2024, promising to bring a more natural and smooth interactive experience and greater practicality. The new version of Siri will be even more powerful thanks to the “Apple Intelligence” generative artificial intelligence model.

The most intuitive change of the new version of Siri is reflected in the new human-computer interaction interface (UI). Soft light effects will appear around the device frame, and responses to user commands will Presented as informative cards. Apple said the new version of Siri will be gradually rolled out to all users "over the next year."

In terms of function upgrades, the new version of Siri will pay more attention to understanding the context of the conversation and avoid users from repeatedly providing information in subsequent commands. Apple claims that “the new Siri will be able to understand and discover content like never before.” For example, when users browse the web, Siri can understand the current content and provide relevant suggestions.

In addition, Siri also supports direct input commands.

At the same time, Siri will also have a "screen awareness" function, which can understand the content the user is browsing and provide operation suggestions for related apps. For example, when you fill out a form and need to enter your driver's license number, Siri can automatically find your electronic driver's license and extract the relevant number to help you complete the form.

The addition of the "App Commands" feature allows Siri to interact more deeply with Apple's own and third-party applications. Apple demonstrated on-site that it allows the "Photos" application to edit the pictures the user is browsing, and Siri can directly complete the operation for him.

In addition, the new Siri will also have a richer product knowledge base to help users solve device usage problems. For example, when a user asks "How do I write a message now and set a delay for sending?", Siri can directly provide guidance on how to use the "scheduled sending" feature added to the iOS 18 Messages App.

Apple emphasized that new features will be rolled out in phases, and more powerful features will be added to Siri during the life cycle of iOS 18.

The above is the detailed content of Siri receives a major upgrade: it has screen awareness and can interact deeply with apps. For more information, please follow other related articles on the PHP Chinese website!