Exploring the human-computer interaction intention of Honor MagicOS 8.0: mutual understanding between users and APPs

With the rapid advancement of hardware, what determines the upper limit of user experience of technological digital products has changed from hardware configuration to software system function settings. AI large models have become a new technology trend, and various AI-based functional applications are constantly emerging. However, we are more looking forward to large-scale AI models that are actually applied on the operating system side.

During the Honor Developer Conference (HGDC) from January 10th to January 11th, a roundtable forum was held, chaired by Wu Bofan, Director of the New Species Research Institute. Guests included Lu Jian, Academician of Nanjing University, Gao Dong Zhenning, Senior Vice President of Detu, Professor Huang Xuanjing from the Department of Computer Science at Fudan University, Associate Professor Yu Chun from the Department of Computer Science at Tsinghua University, Fang Fei, President of Honor Product Line, and Honor CTO Deng Bin, etc. The theme of this forum is "A new generation of operating systems driven by AI large models", and they jointly painted an exciting future outlook. Under this technology trend, they deeply discussed the impact of large AI models on operating systems and the development direction of operating systems in the future. These prospects are fascinating and make people look forward to future technological development.

Create a scenario-based operating system that integrates humans, machines, and objects

Academician Lu Jian believes that the future operating system will become the key foundation to support the three-dimensional integration of humans, machines, and things. This will be achieved through various methods such as intelligent operating systems, ubiquitous operating systems, and scenario-based operating systems. Different from the past, the future operating system will no longer be a passive service provider, but can actively understand user needs, predict user needs, and provide services accordingly. This operating system will flexibly adapt to different needs and provide a personalized service experience based on the characteristics of the application scenario. This development trend will bring a more intelligent and convenient experience to human-computer interaction and promote further innovation and development of technology.

In the development of operating systems, the most important thing is people, but people always need to obey the logic of the machine. The operating system allows people to find applications and services through it, and has become an important driver of technological development.

Since the birth of imperative interaction in 1964 (DOS/Unix era), the emergence of graphical user interface in 1983 (MacOS/Windows era), and the release of iPhone in 2007, we have led the development of natural user interfaces with touch as the core. Birth. However, the interaction logic of this operating system is less efficient and more device-centric than human-centric.

According to the summary of Wu Bofan, director of the New Species Research Institute, it can be seen from the history of human-computer interaction that the relationship between humans and machines is constantly changing. From the earliest requirement of "absolute and unconditional human understanding of machines, to It is possible to not understand the machine absolutely, to understand the machine poorly or not at all. Today, it is increasingly required that the machine understands the person, rather than the process of the person understanding the machine." A brother has happened in the way of human-computer interaction. Pernician transition, "the transition from the sun revolving around the earth to the earth revolving around the sun."

Let’s take a simple example. A friend invites you on social software to have dinner at a certain restaurant at 7 o’clock tonight (clear intention), and attaches the address information of the restaurant. According to the current most mainstream human-computer interaction logic of touch interaction, Before departure, we need to use map software to check the route, so we must first copy the address information in the chat, return to the desktop, find and open the map APP, click on the search bar to paste and then press the search button (search service and recall operation), and finally see it. Corresponding restaurant address information (completed step by step), it takes more than 10 seconds even with a fast hand.

The reason for low interaction efficiency is that the operation process is cumbersome and the location of the map APP and the location of each function need to be clearly defined, otherwise the search time will increase.

The emergence of large AI models is driving a new generation of operating systems to comprehensively change the relationship between people and "machines" and "things", and the beginning of this change will appear on mobile phones. Why mobile phones and not other terminal devices? Professor Huang Xuanjing explained: Nowadays, the hardware configuration of smartphones can efficiently and smoothly run large AI models with 7 billion parameters, providing guarantee for the application of large AI models; there are enough rich and comprehensive APP applications on mobile phones to enable all-round Covering people's lives; mobile phones have been integrated into all aspects of everyone's lives, and can better understand the user's intentions, and then reason about the user's intentions, improving the user experience; finally, mobile phones are devices with strong personal attributes and can protect users well personal privacy.

If we want to further serve users, better improve user experience, and at the same time protect users’ personal data security, device-cloud (large model) collaboration is a very important scenario.

Honor CTO Deng Bin said that in order to understand and predict user intentions, Honor uses true "digital individuals" to turn user behaviors into usable, describeable, quantifiable, and cross-modal behaviors. All professional models also have quantifiable, definable, and promptable intent logic. This is the core capability that Honor will truly build in device-cloud collaboration in the future.

"The tasks in the future will become more and more complex. You may say one bit, but the hidden meaning behind it may exceed 1,000 bits. How can this logic of hidden intentions be truly released, and how can it be reconciled with each (cloud side) ) Specialized models are faced with effective input of specialized macro definitions or input of specialized Prompts. So this is of great significance to our device-cloud collaboration." And this is the latest release of Honor The MagicOS 8.0 operating system pursues the state of "connecting with one another".

MagicOS 8.0: The more you use it, the better it becomes, and the more you use it, the better it understands you

In the past, our interaction model with mobile phones was that if we wanted to do something, we had to disassemble the task, input it step by step into an APP, complete the decomposition of the instruction task in the APP, and then combine it to complete the intention. In the future, we only need to express our thoughts, and the mobile phone can guess the potential intention behind it, and then directly provide a complete closed-loop solution to a complex task.

Let’s take the above example of going to a restaurant to illustrate. On the Honor Magic6 series equipped with MagicOS 8.0, we only need to drag the content on the chat interface to the map APP on the side through the Honor Any Door function, and it will automatically The search will display the address information of the restaurant, or you can take a taxi directly with one drag. If we are worried about forgetting the meal, we can also use any Honor door to create a schedule note with one drag. What used to take seven or eight steps in more than 10 seconds can now be completed with just one drag.

Dong Zhenning revealed that when he first discussed the breadth of user intent recognition with the Honor team, he proposed 17 types of intent recognition scenarios that were just needed. At present, Honor has achieved more than 100 types of intent recognition and can be applied to more users. On the scene. Such accurate intent recognition allows APP applications to provide users with sufficiently accurate and personalized services with the support of platform-level AI.

"The human-computer interaction of intent recognition is a two-way rush, as if there is a twin who really understands you. When you want to find a service, it can recommend the service you want." Fang Fei added , MagicOS 8.0 is a future-oriented scenario-based operating system. Combined with the large-scale AI model capabilities of the device, it can better understand the real-time intentions and thoughts of users, and make it better and better the more you use it, and the more you use it, the better it will understand you. As Deng Bin described this wisdom experience: "You don't know you can live better, you don't know you can do better."

at last

After this roundtable forum, we have a more comprehensive and in-depth understanding of the new generation operating system driven by AI large models. Based on the blessing of a large platform-level AI model, Honor MagicOS 8.0 conducts semantic and behavioral analysis in different scenarios, understands the user's intentions, and provides personalized service feedback, allowing the APP to transform from passive response to active service, innovating the logic of human-computer interaction. , will also become a new paradigm for mobile phones and even other digital devices to interact with people in the future.

Based on this premise, Honor is accelerating its alliance with ecological partners through MagicOS 8.0, using the "Hundred Model Ecological Plan" to connect various services in our lives, jointly build a new AI ecosystem, and realize the infinite imagination together.

It is foreseeable that the relationship between operating systems and application software will also undergo huge changes in the future. The initiation of any task may be served by multiple APPs in the foreground, backend, and middle office. This task serves a certain human intention, and a new industrial model may be born in this wave of centralized integration and comprehensive reconstruction.

The above is the detailed content of Exploring the human-computer interaction intention of Honor MagicOS 8.0: mutual understanding between users and APPs. For more information, please follow other related articles on the PHP Chinese website!