Apple Vision Report

Tracking the latest information on Apple Vision & Spatial Computing. Not affiliated with Apple Inc.

[Apple Vision Report @spatialreport]

Also coming to visionOS 27:

Vehicle Motion Cues, which can help reduce motion sickness for people who use Apple Vision Pro as a passenger in a moving vehicle.

Vision Pro will also support face gestures for performing taps and system actions, plus a new way to select elements with one’s eyes while using Dwell Control.

[Apple Vision Report @spatialreport]

NEWS: As one of its first visionOS 27 features, Apple has announced a new power wheelchair control feature leverages the precision eye-tracking system on Apple Vision Pro to offer a responsive input method for compatible alternative drive systems.

“The option to control my power wheelchair on my own is gold to me,” said Pat Dolan, founder of GeoALS and a member of Team Gleason’s patient advisory board, who has lived with ALS for 10 years. “With this new feature, Apple is developing life-enhancing technology for the people who need it most.”

[Apple Vision Report @spatialreport]

NEWS: As one of its first visionOS 27 features, Apple has announced a new power wheelchair control feature leverages the precision eye-tracking system on Apple Vision Pro to offer a responsive input method for compatible alternative drive systems.

“The option to control my power wheelchair on my own is gold to me,” said Pat Dolan, founder of GeoALS and a member of Team Gleason’s patient advisory board, who has lived with ALS for 10 years. “With this new feature, Apple is developing life-enhancing technology for the people who need it most.”

[Apple Vision Report @spatialreport]

Full story: https://t.co/kMCfb8q1vu

[Apple Vision Report @spatialreport]

NEWS: New England based surgeon uses Apple Vision Pro in world’s first cataract surgery performed in mixed reality

The procedure was successfully completed in October 2025, and since that time, the team has performed hundreds of additional cases using the platform

From the surgeon:
"What we accomplished in that operating room is something that has never been done before anywhere in the world," said Dr. Eric Rosenberg. "This isn't just about a new device, it's about reimagining what the operating room of the future looks like. We've created a platform [ScopeXR] that makes surgeons safer, smarter, and more connected."

[Apple Vision Report @spatialreport]

Full interview: https://t.co/PdLGNJhV4N

[Apple Vision Report @spatialreport]

Future Apple CEO John Ternus talks Apple Vision Pro in his latest interview with @tomsguide

[Apple Vision Report @spatialreport]

@tim_cook 🤍🩶🖤

[Apple Vision Report @spatialreport]

Full interview: https://t.co/5tFDs9kfnN

[Apple Vision Report @spatialreport]

Jon Favreau discusses using Apple Vision Pro on set in upcoming Star Wars film: The Mandalorian & Grogu

Favreau and his team built custom software allowing users to simulate sitting in an IMAX movie theater

[Apple Vision Report @spatialreport]

@benwaddell98 @markgurman Unveil late 2026 or early 2027, release in 2027

[Apple Vision Report @spatialreport]

New details released by @markgurman on what Apple's upcoming AI powered glasses could look like:

• A large rectangular frame, similar to Ray-Ban Wayfarers
• A slimmer rectangular design, similar to the glasses worn by Tim Cook
• Larger oval or circular frames
• A smaller, more refined oval or circular option

Finishes could include black, ocean blue, and light brown, using a high-end material called acetate, which is known to be more durable and luxurious than standard plastic

[Apple Vision Report @spatialreport]

Full story: https://t.co/W1fc7oCGdl

[Apple Vision Report @spatialreport]

First look at X-Plane 12:

[Justin Ryan ᯅ @justinryanio]

Here’s a first look at X-Plane 12 on Apple Vision Pro!

With visionOS 26.4 and NVIDIA CloudXR 6.0, the simulator streams wirelessly at up to 4K/120fps to your headset.

And if you have a physical yoke or throttle, ARKit uses image detection to recognize them and place them inside your virtual cockpit. 🤯 It’ll be available later this spring.

[Apple Vision Report @spatialreport]

Releasing this spring, visionOS 26.4 enables support NVIDIA CloudXR 6.0

The addition enables foveated XR streaming support at up to 4K and 120Hz, allowing immersive content to be rendered on powerful NVIDIA GPUs and streamed to Vision Pro

Apps like X-Plane 12 and iRacing will use the technology to bring realistic flight and driving simulator experiences to the headset

[Apple Vision Report @spatialreport]

More here: https://t.co/Se8xqfetF3

[Apple Vision Report @spatialreport]

NEWS: YouTube has launched a first party app for Apple Vision Pro

[Apple Vision Report @spatialreport]

https://t.co/Qg8X5i0FbB

[Tim Davison ᯅ @timd_ca]

New paper from Apple - Sharp Monocular View Synthesis in Less than a Second

Mescheder et al. @ Apple just released a very impressive paper (congrats! 🎉🥳). You give it an image and it generates a really great looking 3d Gaussian representation. Uses depth pro. It's really good. The model is about 3GB, and takes ~5-10s on my M1 Max per image. Single feedforward pass network.

The video is using "Metal Splatter" to view the .ply from ml-sharp on Apple Vision Pro. Some really wow moments today trying it on different scenes.

[Apple Vision Report @spatialreport]

Apple has released SHARP, an open-source approach to generating a 3D Gaussian representation of a scene from a single image

The 3D representation produced by SHARP can then be rendered in real time, enabling you to step into a generated environment with apps such as 'MetalSplatter' for Vision Pro

[Apple Vision Report @spatialreport]

https://t.co/uERt78TSrx

[Kojiro Yanoᯅ/VR Educator @kojirovr]

Tried ml-sharp by Apple. Here is a generated gaussian splat on Vision Pro. It is surprisingly good! And it runs smoothly on Mac Studio.

https://t.co/tzXgbw5b7D