📷THIS IS VR! NOT OUR TRIPLE SCREEN RIG!📷
In 80 mins we're premiering a new video showing my own Mixed Reality Passthrough software for the Apple Vision Pro and iRacing!
You haven't seen anything quite like this before!
https://t.co/VMvOhjRmQx
#simracing#iracing#vr#mr #mixedreality
@iRacing@Apple
@HardwareSteam If neither is possible, it would be great to know whether this looks like a current software/API limitation or a deeper architectural limitation.
@HardwareSteam Also worth testing whether any headset-side passthrough overlay can remain active over streamed PC content, even if the raw camera feed never reaches the PC.
@coah80 Local headset compositing (Feasible): Valve can update SteamVR/OpenXR so the PC only sends masking metadata. The headset then overlays local camera passthrough directly onto the incoming PCVR stream before display.
@coah80 Sim Racing Limitation
Frame processes passthrough locally on the headset. Because camera data isn't sent to the PC, PCVR games can't blend physical controls (steeringwheel, hands, button box) into the virtual cockpit.
Can Valve fix this via updates?
@coah80 Yes, but the technical approach determines feasibility:
Streaming video to PC (Unlikely): Round-tripping raw camera feeds over Wi-Fi creates severe bandwidth congestion and latency penalties.