After we moved our tiny decoder into SRAM, we only have half a TRIP out of three on SoC B, for this reality visualizer, so spent the compute as best we could. TRIP basically only handles 8-bit int and has to run softmax in emulation mode in 28 steps.
AI5 is a gigantic improvement. Roughly 12X more compute.
In case anyone is curious:
We’ve had a ~pixel-perfect world model since last year, which is critical for synthetic data generation.
The (much) smaller version of that in the car is a conditional mean-flow model, based on the recent sequence of Tesla Universal Vision Encoder features, which are the same ones that are plugged into the 3B encoder model that produces the driving actions.
We fork off from these UVE features, then run a separate ~1B diffusion model. This takes in the previous reality-view generation with added noise and then denoises it to the current visualization.
It then produces a small video chunk (8 images at 36 fps, at the resolution of the UI screen). This work is done by 1/2 of a TRIP engine every UVE frame at 18 hz and is spread over 4 cycles.
Currently, the latency is a bit high due to compute constraints, but we have ways to interleave newer UVE features along the diffusion transformer layers to cut roughly 35% of the latency.
I built a new design interaction called "semantic zoom", where you can pinch and zoom to increase or decrease the granularity of the prose.
One shotted w/ gemini 4 neon.. this model feels great.
In FSD V15, the Tesla AI computer re-renders reality with chevrons in the sky for turns like a video game.
You can tap any point on the reality revisualizer to make your car go there.
I let Gemini 4 Neon make whatever music vid it wanted
At first it failed pretty bad imo, but after a couple days of poking it a bunch:
"THE CURRENT THING"
I’ve developed for the ESP in the past https://t.co/pPimomp83x that’s a good idea - I must start building hardware again. With AI you can spin up projects so quickly. Though for the presence sensor I’d probably pay extra for something that works really well out of the box - though I really do like the appeal of custom software because it allows you to fine tune it
Introducing Exo: an ultra-fast email client for macOS, (heavily) inspired by Superhuman
Exo is pure Rust (no electron/webviews), doesn't need third-party servers, and looks like the best email client out there.
Did I mention it's free and open-source?
https://t.co/nyhVe27qgi