Spatial GPT is here!
A new AI Voice Assistant in Noda will create 3D VR mind-maps in response to your voice prompts 🗣️
It’s Tony Stark level awesome.
Here are a few ways Noda AI blows text-based GPTs out of the water:
1/🧵
Today I'm shipping PortalVR Motion, which turns VR into Wii-style gaming by tracking Joy-Cons in 3D with an iPhone.
VRChat, Half-Life: Alyx, and countless VR titles are now playable in 2D on any PC using Joy-Cons for motion controls. 🧵
Get it now: https://t.co/LzzJM7zKXe
@Volorf@aretalogia Wow, yeah literally possible today using the Noda web api: https://t.co/FP8HOkAQZp
You could load @Replit with the in-app browser in VR and point the agent at api docs and whatever other ai or storage services and have a working app 3d pipeline in no time.
Today I'm releasing PortalVR 2.0, which lets you play the entire SteamVR ecosystem without wearing a headset. You plug in your Quest, put it on your desk, and play on your monitor.
It supports 3D glasses and even 3D monitors! 😎
Get it now: https://t.co/dXqsCjllwt
Thread 🧵
Here is another haptic feedback experiment with hand tracking. This time there are more boxes! Or cuboids, for greater scientific rigor.
I tried using different haptic patterns for different hover effects — it worked very well. Really, haptics are a missing piece in the hand-tracking experience to make it feel solid.
Tools: Unity3D + C#
MR Device: Quest3
Haptic device: HapticLabs's Prototyping Kit
Music: PO-12 and Orchid
New Noda update on the Meta Quest store, including:
Upgraded AI assistant (gpt-5.1 + image model upgrade) with greater spatial intelligence and new onboarding
New ArtStudio Location
https://t.co/QnkFI99TEn
World Models are the path for some AI Models in the future.
But how can we efficiently train these models to not only see the world the way humans do but to see the world in a new and unique way.
By visualizing, what is normally sequenced audio patterns, we can derive much more insights.
Here we see Paganini in a visual form that can than be described and transcribed into a World Model. We can observe connections in a manner that may not have been clear prior to the digitalization of music and sound in this way.
The company with the most valuable potential in building a World Model is Tesla. Not that this type of visualization is being used, but that the mechanisms are in place, and the technology is in place for the company to thrive in this new form of AI.
A new book by author and avid Noda user Michaela Wirtz about using Noda and spatial mind maps for creative expression is arriving soon!
Pre-orders available: https://t.co/AjW5AZH7JH
And a free preview of Chapter 1: https://t.co/gNGNo3YMIc
Great points here about the limiting factors for great MR experiences.
And yet Passthrough on Quest and default non-immersive view on Apple Vision Pro are loved by many who use headsets for productivity and media consumption where they want to stay aware of their surroundings.
I tried to investigate why we don't have a "Killer app" for #MixedReality yet, something like Beat Saber or Gorilla Tag. I came up with some reasons that are holding #MR back and I wanted to share them with you, hoping to foster a debate..
https://t.co/CqvYpCbDmx
#VirtualReality
I've been trying to crack handheld virtual reality.
I think I’ve finally got it. Introducing Portal. Portal lets you play unmodified VR content with just a tablet and a phone.
This early version of Portal aims to solve some big long-standing pain points for VR devs. A 🧵 👇
Figmin XR is coming to #AppleVisionPro! 🥳
With HD graphics, environment reflections, 8k shadows, eye tracking controls and a brand new renderer it's truly our next-gen release!
Coming to you December 18
Preorder today! (Link in comments) 😊
Get Started
You can use this today on the Meta Quest platform with a free download that includes AI credits for experimentation.
https://t.co/jKBgMXWeOa
Explore your interests or make plans for your next adventure with the power of AI & XR!
5/🧵 thanks for reading!🙏
Spatial GPT is here!
A new AI Voice Assistant in Noda will create 3D VR mind-maps in response to your voice prompts 🗣️
It’s Tony Stark level awesome.
Here are a few ways Noda AI blows text-based GPTs out of the water:
1/🧵
Keep Moving
You can continue to move and work in 3d space with 2 hands while the AI processes and performs actions in response to your request.
Get into a flow with the AI answering questions and creating content while you organize and come up with new questions. Or have the AI organize while you create in rapid succession.
4/🧵