Apple Vision Pro changes the way you use your favourite apps, capture and relive memories, enjoy stunning TV shows and movies and connect with others in FaceTime. It has a lot in common with existing virtual and augmented reality headsets, such as Meta Quest, Sony PlayStation VR and Valve Index VR Kit, but it takes a new approach to personal computing. A great deal of attention has been paid to every single piece of technology involved in Vision Pro, in both its hardware and software, to give the user the most intuitive, intimate experience possible. It’s a new kind of computer, one which Apple describes as “spacial computing”. The Vision Pro’s operating system is called visionOS. It features a three-dimensional interface that frees apps from the boundaries of a display so they can appear side by side at any scale. With support for Magic Keyboard and Magic Trackpad, users can bring the powerful capabilities of their Mac into Vision Pro wirelessly, creating an enormous, private and portable 4K display with incredibly crisp text.
The visionOS Operating System
Built on the foundation of macOS, iOS and iPadOS, visionOS was designed from the ground up to support the low-latency requirements of spatial computing. It features a brand-new three-dimensional interface that makes digital content look and feel as though its present in the physical world. Apple Vision Pro introduces an entirely new input system controlled by a person’ts eyes, hands and voice. You can browse through apps by simply looking at them, tapping your fingers to select, flicking their wrist to scroll or using your voice to dictate.It also features EyeSight, which helps users stay connected with those around them. When a person approaches someone wearing a Vision Pro, the device allows the user see them. When this is the case, your eyes are shown on the outside of the goggles, so those in the room know you’re looking through the Vision Pro at the room as well as at the operating system. When a user is immersed in an environment or using an app, EyeSight doesn’t display the eyes, letting those in the room know the user isn’t looking at them.
A great deal of care and attention has been taken in designing the hardware. It packs an amazing amount of technology into its compact design. A singular piece of three-dimensionally formed and laminated glass is polished to create an optical surface that acts as a lens for the wide array of cameras and sensors needed to blend the physical world with digital content. The glass flows into the custom aluminium alloy frame that gently curves around the user’s face, while the modular system allows for a tailored fit to accommodate a wide range of head sizes and face shapes.
The Light Seal is made of a soft textile, and comes in a range of shapes and sizes, flexing to conform to the face for a precise fit. Flexible straps ensure audio remains close to the ears, while a Head Band is available in multiple sizes’ is three-dimensionally knitted as a single piece to provide cushioning, breathability and stretch. The band is secured with a simple mechanism, making it easy to change to another size or style of band.
Apple Vision Pro is powered by two Apple silicon chips. It uses micro-OLED technology to pack 23 million pixels into two displays, each the size of a postage stamp, with wide colour and high dynamic range. Custom catadioptric lenses allow for a high degree of sharpness and clarity, and ZEISS Optical Inserts for those who wear glasses ensure visual fidelity and eye-tracking accuracy.
The visuals are augmented by an advanced Spatial Audio system, creating the feeling that sounds are coming from the environment around the user and matching the sound to the space. Two individually amplified drivers inside each audio pod deliver Personalised Spatial Audio based on the user’ts own head and ear geometry.
To follow the wearer’s eye movement, there’s a high-performance eye tracking system with high-speed cameras and a ring of LEDs that project invisible light patterns onto the user’s eyes. This eye tracking is used to help you interact with visionOS.
Underpinning the Vision Pro’s hardware are two Apple Silicon processors. The M2 system-on-a-chip delivers unparalleled standalone performance, while the brand-new purpose-designed R1 chip processes input from twelve cameras, five sensors and six microphones to make sure content feels like it’s appearing right in front of the user’s eyes, in real time. The R1 streams new images to the displays within 12 milliseconds, eight times faster than the blink of an eye. Apple Vision Pro is designed for all-day use when plugged in, and can run for up to two hours when powered by its external, high-performance battery.
You can use the Apple Vision Pro to make and receive FaceTime calls. These video chats take full advantage of the room around the user. Everyone on the call appears in life-size tiles, and Spatial Audio makes it sound as if their voices are coming from their tile. If, for example, your mum’ts tile is on the right, her voice comes from the right too. You might assume FaceTime chatting with someone wearing a Vision Pro is distracting \’96 who wants to see a pair of goggles during a video chat? But this isn’t how it’s done. Instead, users wearing a Vision Pro are represented by a Persona, a digital representation of that person created using Apple’s most advanced machine learning techniques. The Personal movements reflect the user’s hand and face movements in real time.
More About Vision Pro and visionOS
For movies and TV, Vision Pro’s two ultra-high-resolution displays transform any space into a personal movie theatre, with a screen that feels 100 feet wide and an advanced Spatial Audio system. Gamers rejoice! Spatial computing makes new types of games possible with titles that can span a spectrum of and bring gamers into all-new worlds. Users can also play over 100 Apple Arcade games on a screen as large as they want. Vision Pro supports popular game controllers.3D photos and videos are possible with Vision Pro, with videos augmented by spacial audio. It’s a great way to make memories. Vision Pro has an all-new App Store where users can find apps and content. iPhone and iPad apps work with Vision Pro, and soon developers will release apps specifically designed for the spacial computer.For privacy, Optic ID is a new secure authentication system that analyses a user’s iris under various invisible LED light exposures, and then compares it to the enrolled Optic ID data that is protected by the Secure Enclave to instantly unlock Apple Vision Pro.