Current SOTA VPS: MultiSet AI, ranked most robust in 2025 AREA report, offers cm-level accuracy indoors/outdoors, resilient in dynamic lighting.
SOTA visual SLAM: SEGS-SLAM or OGS-SLAM (2025 papers), using Gaussian Splatting for photorealistic mapping and low-drift localization.
Comparison:
- Performance: VPS excels in precision (e.g., <6cm) with pre-maps; SLAM achieves similar (e.g., 2-5cm ATE) but builds maps on-the-fly for unknown areas.
- Efficiency: VPS is faster for queries; SLAM requires more compute for real-time mapping (~17 FPS tracking).
- Reliability: VPS stable in mapped, varied environments; SLAM robust to changes but prone to drift in low-texture or dynamic scenes.
One of the things I’ve been obsessing over recently is how to build a spatial platform with a minimal stack. Building an AR platform currently comes with a lot of bloat, and a headless architecture is something I’ve been exploring.
The key things I wanted to achieve were avoiding platform lock-in and offloading compute to the cloud while still maintaining complete control over the camera pipeline and localization input.
And as always, @multiset_ai had a solution for this. Using their APIs, I built a fully headless spatial layer. And I have made a tutorial so you can build it too!
It was a challenging video to execute, but I think I did a good job! Link below!👇
Wall hacks in real life using augmented reality.
New mad science experiment -- I used $300 Meta RayBan glasses and an iPhone to recreate EagleEye's "see-through-walls" tracking.
The answer was visual positioning tech to build a shared spatial map. Code on GitHub.
0:00 - The Experiment
0:38 - Dumb Glasses, Smart Tracking
1:54 - No Street View? No Problem
3:17 - Seeing Through Walls With a Phone
4:24 - The Indoor Problem Nobody Solved
5:20 - This Is What It Can Do
6:38 - Use Cases Beyond the Flex
7:44 - The Double Edge
10:32 - Conclusion
On the sidelines of @ycombinator's Startup School India. We are teaming up with @multiset_ai and hosting an XR Meetup for folks in Bengaluru!
If you are someone who is building in this space or is interested in AR and VR. Make sure you join! We have some really great people joining!
We have @sawlaninik joining, who has built some truly great products, including @Multiset and ARWay.
@Virendra0698 will talk about @anomalysims and all his other truly great projects. I bet you have seen him a lot on your timeline!
And @RangeshUs will be talking about how he is building the next gen of apps using Smartglasses.
Make sure you RSVP using the Luma below. See you soon!
Meta just featured MultiSet AI on their official developer blog.
We built on the Wearables Device Access Toolkit to stream camera frames from Ray-Ban Meta glasses directly into our VPS engine. Real-time location tracking. Navigation. Hands-free.
The Wearables Device Access Toolkit is in developer preview.
Extend your app with camera and audio inputs and build real-time, hands-free experiences.
Early integrations are already live—check them out. https://t.co/QOdj8ooXmq
With this awesome feature, @multiset_ai also allows you to run your AR application fully offline, on-device. You can download your map once or embed it in your APK itself. And the way it works is pretty neat! If you are looking to build on top of this, check my tutorial linked below👇
Why have users unwittingly helped build fragmented 3D map of the world, isolated hotspot scans of public spaces with little meaningful connectivity 🌍, when you can run the world’s most robust, private VPS in your own cloud ☁️🔒?
VPS tracking on smart glasses
Experimenting with @multiset_ai’s Visual Positioning System (VPS) to determine a person’s position relative to a 3d scanned environment, using just an image
Works with compatible smartglasses, in this case @omidotme’s Omi Glass (based on @seeedstudio’s ESP32-S3 Sense) running our custom firmware
Tutorial video for Object Tracking with @multiset_ai is up on YouTube now. link below👇
It's really interesting how you can scan any object with polycam etc. And turn that GLB into a fully tracked object anchor in your AR scene.
📍 VPS (Visual Positioning System) by @sawlaninik from @multiset_ai
A sample iOS application demonstrating Visual Positioning System (VPS) integration with Meta Ray-Ban Smart Glasses. This app showcases localization and turn-by-turn navigation using the MultiSet VPS API and Meta Wearables Device Access Toolkit.
> https://t.co/6IpJ49Q7G7
Smart glasses just got spatially intelligent. 🚀
@multiset_ai VPS now supports wearable devices, starting with Meta Ray-Ban smart glasses. With <5 cm location accuracy, glasses gain a precise understanding of device position.
A great visual positioning system makes augmented reality feel like magic... this tech helps your phone (or robot) figure out precisely where it is in 3D space.
Here's MultiSet AI nailing it in real-time, at night, and on-device too. This new reveal shader animation shows just how well it's working.
IMO this tech is slept on despite being key infrastructure for physical AI to actually work.
A great visual positioning system makes augmented reality feel like magic... this tech helps your phone (or robot) figure out precisely where it is in 3D space.
Here's MultiSet AI nailing it in real-time, at night, and on-device too. This new reveal shader animation shows just how well it's working.
IMO this tech is slept on despite being key infrastructure for physical AI to actually work.