Innovative interactive experience debuts: Quest Pro headset realizes Nova UI interface operation through eye tracking

According to news on July 6, Supernova Technologies recently successfully demonstrated their product based on Unity and Nova on the Quest Pro headset. The UI framework is developed to simulate the eye tracking interface of Apple Vision Pro. Through a demo video, Supernova Technologies showed off their Quest An interactive experience similar to Apple’s Vision Pro implemented on the Pro headset.

#The video demonstrates the use of gestures for slider adjustment, button switching, and resizing operations. However, it’s important to note that this demo is limited to Nova UI interface elements are not applicable to most third-party applications. In addition, due to the hardware limitations of the Quest Pro headset, hand tracking cannot achieve the experience of Apple's Vision Pro.

According to the demonstration in the video, the Apple Vision Pro is equipped with a downward-facing camera, which means that users can still perform gesture operations even if their hands are placed on their knees or on the sofa. However, Quest The Pro headset doesn't have a downward-facing camera, so users must hold their hands in the air for gesture recognition.

As far as I know, you can now download Nova’s VisionOS demo APK on GitHub and sideload it to Quest Try it on the Pro headset. However, it should be noted that since the Quest 2 or Quest 3 headsets do not support eye tracking, this demo cannot run on these two headsets.

This breakthrough from Supernova Technologies brings more interaction possibilities to the Quest Pro headset. Although it is impossible to completely copy Apple Vision Pro features, but this demo gives users a new way to interact with virtual reality environments. We look forward to seeing more innovation and development with the Quest Pro headset in the future.

The above is the detailed content of Innovative interactive experience debuts: Quest Pro headset realizes Nova UI interface operation through eye tracking. For more information, please follow other related articles on the PHP Chinese website!