What are the future killer features of VR headsets?

There is no need to change the original meaning. What needs to be rewritten into Chinese is: these functions,

Is there any chance it will become the “standard configuration” of future VR headsets?

文 | Qingya White Deer

(VRPinea October 30, 2023) "I can't tell you when it will happen. Each headset has its own configuration plan. But in the future, the rewritten content will be: Pupils Tracking will become a standard part of VR headsets, but I’m not sure when.”

The above paragraph is Meta CTO (Chief Technology Officer) Andrew Bosworth’s reply to fans on the social platform recently, rewritten as: pupil tracking issue. Obviously, Andrew Bosworth and VRPinea reached an agreement on this issue, "Will eye tracking become the "standard configuration" of XR in the future? 》.

（Meta CTO Andrew Bosworth）

In today’s article, Xiao P will talk about the current development trend of VR headsets. Which functions have the opportunity to be transformed from the original external modules or exploratory attempts to become normalized standard configurations. Incorporated into the basic functions of VR headsets.

Rewritten content: Pupil tracking

First of all, of course, let’s talk about the topic of pupil tracking. The rewritten content is: Pupil tracking is now a very mature technology. Globally, the two companies with the largest accumulation of technical achievements and business cases are Sweden's Tobii and domestic manufacturer Qixin Yiwei. For related sharing, readers can go to "Long Talk | "Lao Miao Talks about Technology" Interview with Qixin Yiwei: The rewritten content is: There are many things that pupil tracking can do."

("Lao Miao Talking about Technology" Qixin Yiwei interview screen) needs to be rewritten

The rewritten content is: The relationship between pupil tracking and VR headsets is complementary to each other. VR is a carrier that is naturally suitable for carrying the rewritten content: pupil tracking module. Moreover, adding eye tracking function to VR headset can play a significant role in improving the image quality, performance and human-computer interaction of the hardware.

In terms of image quality improvement, that is, gaze point rendering and line of sight tracking rendering. You can appropriately reduce the resolution of the peripheral images to ensure that the area where the human eye is looking is always clear. To put it bluntly, it means "wherever you look, there is clarity."

(Focus rendering rendering)

In addition, in the field of virtual social interaction, the application of eye tracking and facial capture is also very important. By simulating expressions, the realism of virtual social interaction can be improved, thereby improving social comfort and emotional transmission effects

Another point is that pupil recognition and iris authentication functions are also inseparable from the support of eye tracking technology. This feature has been implemented on Apple Vision Pro, "Optic ID". Such functions play an important role in device security, virtual payment, etc.

The content that needs to be rewritten is: "Optical Recognition"

Environment Awareness

VR head-mounted environment perception has been mentioned repeatedly in recent months. In this aspect, there is actually a relatively clear development path: completely closed - VST grayscale perspective - VST full-color perspective - environmental perception.

Based on technologies such as high-definition cameras, depth sensors, fusion algorithms, and high-computing chips, virtual reality (VR) headsets can realize the function of environmental perception. Compared with video see-through (VST), which can only "see" the external environment clearly, environment perception has higher requirements, and its goal is to achieve "seamless integration" of virtual space and the physical world

Only when environmental awareness reaches this stage, stable basic support can be provided for the MR experience. When a VR headset realizes 3D reconstruction of the physical environment through accurate object recognition and depth calculation, and superimposes low-latency, interactive virtual content on this basis, it can truly be called an MR experience

The content that needs to be revised is: (environment perception diagram)

Gesture Recognition

Gesture recognition is not a new technology, but because Apple released Vision Pro in June, more people began to pay attention to it. Compared with current virtual reality hand controllers, gesture recognition as a human-computer interaction method is undoubtedly more natural and easier

However, this does not mean that "de-handling" is necessarily the correct path. Considering the accuracy of current technology, there are still problems with the stability of recognition, the judgment of different gestures, and the misrecognition of hand movements

However, even if gesture recognition has the above problems, after Apple Vision Pro became the first to try it, there are still VR manufacturers who choose to follow up. In fact, the reason is very simple. There is a problem with accuracy. However, in the process of VR human-computer interaction, there are also many operations that can be achieved without being too precise, such as screen zooming, UI control, etc.

(Apple Vision Pro promotion screen)

The content that needs to be rewritten is: AI (Artificial Intelligence)

What AI needs to rewrite is: Regarding the correlation between AI (Artificial Intelligence) and XR, what currently attracts more attention is the strong correlation between AI and AR. It can be said that within the framework of real AR glasses, the correctness of AI AR paths has basically been recognized by the industry. But in fact, VR headsets also need the blessing of AI, and AI can bring more improvements to the VR experience.

The more intuitive point is the AI ​​voice command, which is also part of the natural interaction logic of hands, eyes, and mouth proposed by Apple. Regardless of the external environment (in public places), it is undoubtedly the most natural and efficient to operate a VR headset through voice commands.

(Apple Vision Pro promotion screen)

In addition, local AI based on high computing power chips can also significantly improve the performance of VR headsets. As mentioned above, environmental perception, physical environment reconstruction and virtual-real interaction are all inseparable from the support of powerful AI.

Local AI can also serve as a personal intelligent assistant for VR users, thereby releasing more and greater VR productivity. For specific images, please refer to Iron Man and Jarvis. AI can also be integrated into VR games to provide intelligent support for game NPCs and develop more non-linear game development paths. For specific pictures, please refer to "Out of Control Player".

(Poster of "Out of Control Player")

Tactile feedback

VR equipment deceives people’s five senses, including vision, hearing, touch, smell and taste, by simulating the virtual world. Current technological development is mainly focused on realizing the first three, or the first two and part of the sense of touch. Touch is actually achieved through different degrees of vibration. As long as the vibration feedback is simulated finely enough, the tactile experience can be more realistic

The currently popular virtual reality headsets can actually be regarded as having relatively rudimentary tactile feedback functions, such as the vibration of the handle. However, simple mechanical vibrations are far from comparable to real touch. At this point, Sony’s PS VR2 goes further

PS VR2’s Sense controller can accurately transmit the tactile sensations of different objects in the game to the user’s hands through the built-in tactile feedback component. Only such performance can achieve tactile feedback and truly simulate sensory experience and virtual reality

(User holds PS VR2 Sense controller with both hands)

In order to rewrite the content without changing the original meaning, the content needs to be rewritten into Chinese. What follows is a paraphrase of the original content. in conclusion:

The Great Wall was not built in a day, things are constantly improved in the process of development. When the telephone was first invented, people did not imagine that one day smartphones would become indispensable personal terminals. Therefore, only by continuously optimizing and upgrading hardware and software and adding more valuable and practical functions can VR headsets go further.

This article is original to VRPinea. If you need to reprint it, please contact: brand@vrpinea.com

The above is the detailed content of What are the future killer features of VR headsets?. For more information, please follow other related articles on the PHP Chinese website!