A bit late on this but congratulations to the @yutori_ai team for taking #1 on the MyPCBench leaderboard ๐ Happy to see more work on pushing forward personalization + computer-use!
The evidence lies at https://t.co/4HZiGxR76l
Navigator N2 should be the default CUA model you try, but dont listen to me listen to the benchmarks! It also costs an order of magnitude less than Opus :)
https://t.co/8sBwBN69qV
๐ก๐ฎ๐๐ถ๐ด๐ฎ๐๐ผ๐ฟ ๐ป๐ญ.๐ฑ โ๐๐ผ๐น๐๐ฒ๐ฑโ ๐ข๐ป๐น๐ถ๐ป๐ฒ ๐ ๐ถ๐ป๐ฑ๐ฎ๐ช๐ฒ๐ฏ: ๐ต๐ณ.๐ฏ% ๐๐๐ฐ๐ฐ๐ฒ๐๐ ๐ฟ๐ฎ๐๐ฒ.
While some teams self-report, this result is independently evaluated and verified by OSU NLP Group @osunlp and Careerflow Human Data Labs.
All benchmarks are transient attempts at measuring progress. Ultimately, what matters is how a model performs when people use it.
But thereโs a sentiment online that computer-use models arenโt progressing quickly.
Not true.
In the last year, performance on Online Mind2Web has gone from ~40% success to basically saturated.
So whatโs next?
Most computer-use/browser-use benchmarks are GUI-only. Models (including Navigator n1.5) now support hybrid actions โ UI interactions (click, type, scroll) and programmatic actions (e.g., execute JS).
Ultimately, weโre headed to a world where computer-use models โagentifyโ the long-tail of the web.
https://t.co/E1B81aU0wa
@willcb Is it not clear that this debate is group based advantage estimation vs critic based? Anyone thatโs reading more into it is either missing the forest for the trees or prioritizing the wrong experiments wrt algo exploration
I donโt like Pulse in ChatGPT Pro. Its inaccurate, serves a lot of older information and is mostly slop. Which is weird, given how good ChatGPT is w/ search.
Scouts by Yutori (CUA startup) does those things better, imo.
co-driving RL for Navigator - our SOTA browser use agent - has been a professional highlight for me, have learned so much working on it with @CysuXiao. read the blog post (linked below) for more!
Introducing Yutori Navigator
31 years ago, the modern web era began with Netscape Navigator.
Today, weโre introducing Yutori Navigator โ a web agent that autonomously navigates websites on its own cloud browser to complete tasks for you.
Navigator achieves pareto-domination over Gemini 2.5, Claude 4.5, and OpenAI Operator
โข 10%-20% accuracy gains across benchmarks
โข 2-3x faster
โข Uniformly preferred in head-to-head human-evals
Simply put, the best web agent in the world
@finbarrtimbers@natolambert another place this comes up is when it *always* uses .get on dicts instead of raw indexing. donโt think it learned that sometimes raising an error is good because it means something is wrong lol
@YiTayML agreed! (except blame being on you :))
we were definitely too grounded in the pre train-finetune and transfer learning paradigm, which was apparent when flan (and instructgpt) came out.
though personally it was a great learning experience for me so early in my career :)
honestly ai is so easy and neural networks are so simple. this was always going to happen to the first intelligent species to come to our planet. weโre about to learn something important about how universes tend to go I think, because I donโt believe weโre in a niche one