Introducing Orion, a foundation model that predicts where you look. Orion finds twice as many UX bugs as frontier models, cuts computer-use latency by 31%, and even won a drone race.
@JustinSlud Yes, here’s an example on TikTok, but the model also generalises to long form videos (though less well due to a sparser interaction stream)
https://t.co/kyNvjWbrtG
A very interesting area of research!
The future of voice interfaces requires a large amount of visual understanding as well
Both will come hand in hand