This week’s big news for XR, after the release of Quest 3 last week, this week’s Apple MR headset Vision Pro was officially released, which is also the highlight of this week’s AR/VR news.
In terms of AR, Apple released the VST headset Vision Pro (although it is essentially a VR device, but it focuses on AR scenes) and visionOS; visionOS SDK will be launched at the end of the month; Object Capture supports iOS; Kopin launches monochrome 1-inch ultra-large Micro LED Mods.
In terms of VR, Meta will demonstrate retinal zoom VR at SIGGRAPH 2023; Quest launches a pure gesture virtual keyboard; Huiniu releases two new Pancake products; and Ejing three products will be unveiled at AWE 2023.
In terms of acquisitions, Apple acquired AR head display manufacturer Mira; Vection acquired VR solution provider Invrsion.
In terms of financing, Micro LED manufacturer JBD completed Series B financing, with Alibaba taking a stake; consumer XR glasses brand VITURE received nearly 10 million US dollars in Series A financing; VR corporate training platform InstaVR completed 1 billion yen in financing; psychological therapy VR solution provider BiPSEE received a new round of financing.
AR｜Apple Vision Pro officially released
There is no doubt that Apple’s Vision Pro is the highest level of VST, even though it is a VR device. The crazy pile of materials gives it obvious enough features: a Micro OLED screen with a single-eye 3.4K resolution, a high-quality lens, and an unprecedented curved ID structure design (with curved glass, motherboard, battery, etc.); as many as A combination of 12 cameras, 5 sensors, and 6 microphones; and a powerful eye gesture and voice combination interaction mode. Related reading: "The ceiling of VST?" Apple Vision Pro Analysis》.
AR｜Vision Pro uses AI to detect user status
Sterling Crispin, a former Apple AR engineer who participated in Vision Pro, posted an article sharing the work he did during his time at Apple. It is mentioned that Apple Vision Pro incorporates a large number of machine learning technologies, including using AI models to predict your body and brain states, such as whether you are curious about current affairs, whether you are distracted, whether your attention is distracted, etc. Recommended reading: "Apple Vision Pro uses rich AI technology to detect user status".
AR｜Apple Vision Pro screen details exposed
Mentioned in the WWDC 2023 course: The refresh rate of the Vision Pro headset is between 90Hz-96Hz, and it can play up to 4K resolution 2D video. The native refresh rate of the display is 90Hz. If you play a 24fps video, it can automatically Use special 96Hz mode. On this basis, Vision Pro can present a wide and vivid color range and support SDR and HDR display technologies.
AR｜Vision Pro prescription lenses or $3-600
Bloomberg reporter Mark Gurman said that a pair of Zeiss prescription lenses for the Vision Pro may cost at least US$300-600. If Apple does not provide corresponding subsidies, the cost for myopic users to purchase the Vision Pro headset can be as high as about US$4,000.
AR｜Apple proposes MV-HEVC 3D video format
Apple has introduced an HEVC extension format: MV-HEVC, which refers to multi-view HEVC. Each frame of image carries two pictures for the left and right eyes, which is a format specially launched for 3D video.
AR｜Industry executives comment on Vision Pro
Qingting.com has invited executives and scholars in the AR/VR industry to comment on the new Apple Vision Pro product, as well as the prospects and impact of visionOS and spatial computing. Let us listen to their views and analysis. Articles for reference: "Reviews of Vision Pro among AR/VR Industry Executives".
AR｜Zuckerberg comments on Vision Pro
In a recent Meta internal conference, Zuckerberg commented on Apple Vision Pro. Read more about Vision Pro: Two Companies with Different Visions and Values
AR｜Kopin Monochrome MicroLED Module
Micro display solution Kopin announced a 1-inch MicroLED module, which is currently in the production verification stage. It is characterized by monochrome, resolution 2048x2048, and brightness exceeding 2.8 million nits. It is expected to increase to between 3.2-3.5 million nits in the future. The initial version is reportedly designed for defense and augmented reality scenarios and is based on Kopin’s own developed backplane and driver technology.
AR｜visionOS infrastructure
visionOS is mainly based on several major frameworks: SwiftUI, RealityKit, and ARKit, and development tools include Xcode, Reality Composer Pro, and Unity. Most of these have been launched before, but it is worth noting that Reality Composer Pro is a new tool that provides developers with a workflow for previewing and preparing 3D content. Here is the rewritten sentence: You can read articles related to the Vision Pro headset, such as "Peering into the Vision Pro headset from the visionOS system"
AR｜visionOS User Interface
visionOS has three major types of interfaces: window view, volume view (stereoscopic), and Space view (two types in total, one is the opaque background mode Full Space, and the other is the VST perspective background Shared Space).
In Space view, users can adjust the degree of background perspective by rotating the digital knob, allowing the UI to transition naturally between full immersion and full perspective.
AR｜visionOS window view sharing
visionOS can allow users to share any window just like macOS. At this time, visionOS will synchronize the user's orientation, as well as AR scale, animation and contextual information, allowing everyone in SharePlay painting to get the same experience, thereby enabling remote visual collaboration .
AR｜visionOS supports iOS applications
According to Apple, Apple Vision Pro (visionOS) will be compatible with applications on iOS and iPadOS. In terms of details, iOS applications are displayed in portrait mode, and iPad applications support both landscape and portrait modes. Developers can set the default mode; support window scaling; securely manage Touch ID or Face ID to automatically change to Optic ID; support custom gesture recognition Function.
AR｜visionOS input method exposed
Apple explained in detail the various input methods supported by Vision Pro in the WWDC course, such as using gesture virtual keyboard, matching Bluetooth keyboard to input text, etc. Related reading: "Apple's visionOS input method exposed: eyeball gaze and gesture keyboard with ultra-high accuracy"
AR｜visionOS Developer Support Service
In the "Work with Apple" section of Apple's official visionOS page, Apple mentioned that it will hold a series of activities and provide developers with three channels and methods to test visionOS applications and other services, which will be launched in July.
AR｜visionOS SDK will be launched at the end of the month
Apple announced that it will launch visionOS SDK before the end of this month and push new versions of Reality Composer and Xcode tools.
AR｜Object Capture supports iOS
In the WWDC 2023 course, Apple stated that the photogrammetry function Object Capture, which was previously only available on Mac, now supports iOS, which means that more third-party apps can directly implement 3D scanning modeling in USDZ format. Currently, the app mainly supports iOS devices with LiDAR sensors.
AR｜ARKit-World Tracking
Although it is not explicitly said to be ARKit7, ARKit also has several new features: World Tracking. Developers add WorldAnchor anchor points. Any anchor points will be automatically saved in the background of the system and will still be displayed every time the device is restarted. in a fixed position.
AR｜ARKit-Scene Understanding
This feature set covers multiple functions for identifying the surrounding environment, such as: plane vertical and horizontal detection, scene geometry, and image tracking. The recognized surfaces can be used to anchor AR content or optimize physical simulations, allowing AR to interact naturally with floors and walls.
AR｜ARKit-Particles
Particles new tool, this tool can quickly build dynamic particle effects such as clouds, rain, sparks, etc., and supports previewing in Reality Composer Pro.
AR｜RoomPlan update
RoomPlan is a feature brought by ARKit 6. The updated features of this WWDC are as follows: custom AR session, support for multi-room (MultiRoom API), more identifiable objects (such as tilted, curved walls, or dishwashers) , oven, sink and other elements.)
AR｜Vision framework supports detecting animals
Vision framework will add Animal Body Pose API, which is characterized by tracking multiple skeletal nodes of cats, dogs and other animals to achieve full body posture tracking. It is reported that this API only supports iOS 17, iPadOS 17, tvOS 17 and macOS Sonoma systems.
AR｜Apple 3D display UI patent
WIPO announced a 3D UI system from Apple, which is characterized by the ability to identify walls, desktops and other elements in the scene, and fix the interactive UI on these physical elements, as if an ordinary room can be arranged into an infinite 3D canvas.
AR｜Apple Face ID binding vision information
USPTO announced an Apple AR glasses authentication system based on facial recognition, which is characterized by binding the user ID with vision information such as diopter. When a specific user is identified with the mobile phone's Face ID camera, the vision information will be combined with AR Glasses sync.
AR｜Apple eye gestures combined with interactive patent
WIPO published an Apple patent related to AR/VR headsets, describing a natural GUI interaction method that integrates eye tracking and gesture tracking. It is characterized by using depth mapping to track gestures and intelligently identifying the user's thoughts through gaze points. The virtual elements to be controlled make the interaction in AR/VR smoother and reduce the resistance to use. The interaction logic is very similar to the released Vision Pro.
AR｜Amazon introduces 3D modeling tool Hexa
3D AR visualization platform Hexa announced that it has joined forces with Amazon's imaging team and AWS's spatial computing team to launch a scalable and simple 3D AR development process to accelerate the process of e-commerce partners using AR for marketing and display.
VR｜Meta will demonstrate retina zoom VR
Reality Labs Yang Zhao and Douglas Lanman, the people behind two zoom display VR prototypes (Half Dome, Butterscotch), will participate in SIGGRAPH 2023 in August this year, during which Meta plans to demonstrate a zoom VR with retina-level resolution Headset prototype.
VR｜Quest Push Gesture Virtual Keyboard
Meta this week launched a virtual keyboard feature based on Quest, which allows users to type directly in the virtual keyboard through gestures. This feature will be integrated into the Presence platform and Unity Integration SDK, allowing developers to introduce gesture-based virtual keyboards into their own AR/VR applications.
VR｜Huiniu releases two new Pancake products
Huiniu Technology, as a supplier of AR/VR optical modules, has launched two new Pancake modules, namely Si-PK95 and PK100. Si-PK95 uses a 1.3-inch Si-OLED screen and a single-eye 4K*4K resolution; PK100 uses a 2.48/2.56-inch LCD screen and supports a single-eye resolution of 1920*1800/2160*2160. This module achieves a large field of view. At the same time, it is thinner than similar products already on the market, with the module thickness only 26mm.
VR｜Yijing XR debuts at AWE 2023
Three products that EmdoorVR leads or participates in research and development are on display at the Qualcomm booth at AWE 2023: Emdoor’s self-developed 6DoF MR all-in-one machine, Rokid split AR glasses computing unit, and ClassVR 3DoF MR all-in-one machine for education customers. The new MR product A863 uses the latest generation of Qualcomm Snapdragon XR2 platform, equipped with Qualcomm's latest LA1.2 baseline, supports OpenXR standard, has head 6DoF and hand 6DoF, gesture recognition, eye tracking, VST (using dual 1600M color cameras), IPD stepless adjustment; 2160 *2160 dual-screen HD resolution, super large 105° FOV.
VR｜AAC Technology mass-produces 3P Pancake
AAC Technology announced that its 3P VR Pancake optical module has successfully started mass production. It claims that the module can more effectively resist dizziness and is more friendly to myopia patients, while the edge image quality is also clearer.
VR｜AVATAR VR surgery obtained FDA certification
AVATAR MEDICAL, a surgical VR medical imaging solution provider, announced that its VR preoperative planning solution has obtained FDA 510(k) certification and is expected to obtain European medical device certification next year.
VR｜Unity Space Application Development Kit
The Apple Vision Pro head display was just released at WWDC 2023. At the same time, Unity also announced that it is cooperating with Apple to launch a spatial experience development kit: Spatial Creation for the head display operating system visionOS. It is reported that the tool has now opened test reservations.
VR｜ILMxLAB changed its name to ILM Immersive
As part of the overall brand plan of Industrial Light and Magic (ILM), ILM’s studio ILMxLAB announced that it will rebrand and change its name to ILM Immersive. It is reported that the studio was established in 2015 and has focused on developing VR, MR and other IP-based products for many years.
VR｜Disney Plus Apple starting lineup
VR｜4 Vision Pro apps released
Apple officially announced that the AR/VR platform visionOS has third-party developers, including: Algoriddim, Ryan McLeod, JigSpace, XRHealth, etc. It is reported that the AR/VR applications developed by these developers involve various types, such as interactive music, puzzle games, medical solutions, gesture applications, etc.
VR｜Virtual Desktop update version 1.27
In the 1.27.0 beta version, "Virtual Desktop" brings the following key optimizations: adding HEVC 10bit codec, adding H.264 codec option, supporting up to 400Mbps; improving foveated encoding; PC desktop streaming The bit rate is increased to 100Mbps; the Quest side switches to the OpenXR standard and supports the VST perspective environment; the Quest Pro side supports local dimming; it supports the PS5 DualSense controller.
Acquisition｜Apple acquires AR headset manufacturer Mira
Acquisition｜Vection acquires VR solutions provider Invrsion
Financing｜JBD completed Series B financing
Financing｜VITURE received nearly 10 million U.S. dollars in Series A financing
Financing｜InstaVR completes 1 billion yen financing
Financing｜Japan’s BiPSEE received new financing
BiPSEE, a Japanese psychotherapy VR solution provider, has received a new round of financing from Beyond Next Ventures, ANRI, Scrum Ventures and Ocean Lease. The funds will be used to accelerate the development of VR digital therapy for depression.
The above is the detailed content of Vision Pro headset released; Apple acquires AR manufacturer Mira. For more information, please follow other related articles on the PHP Chinese website!
![[Web front-end] Node.js quick start](https://img.php.cn/upload/course/000/000/067/662b5d34ba7c0227.png)
