Grok 4.20 was the most complex training run yet. We optimized for the highest intelligence density at each step without trading off real world usability through a novel recipe. More improvements and evals to come as the beta matures π
Grok 4.20 beta1 (single agent) debuts #1 on Search Arena, and #4 overall in Text Arena!
Highlights:
- #1 in Search, scoring 1226, leading GPT-5.2 and Gemini-3
- #4 in Text, scoring 1492 on par with Gemini 3.1 Pro
Congrats to the @xAI team and @elonmusk on this impressive milestone!
Grok 4.5 generalizes to really hard long-horizon benchmarks! Something that seemed far-fetched just a few months ago, but is exactly what grit and rapid iteration by an awesome team and resources at @SpaceXAI make possible.
Proud to have helped shape the RL recipes behind it: coding, ML, and long-horizon tool use, a lot more to come!
Grok 4.5 is live! We rebuilt our RL recipes form the ground up for frontier agentic intelligence and efficiency. Upcoming longer horizon benchmarks might surprise π
Announcing Grok 4.5, our first model trained specifically for coding and agents. It was trained with Cursor and offers frontier intelligence at leading speeds and cost efficiency.
https://t.co/i8HpU7w64k
Exponentials are funny, one would think you get used to them seeing the progress over past few years. But then a new one comes along that's even more fascinating than the last
We expect agents to act like senior engineers, but most benchmarks still evaluate them like interns.
Excited to introduce Senior SWE-Bench, an open-source and @harborframework-native benchmark that assesses agents as senior engineers on long-horizon tasks with realistically under-specified instructions.
We expect agents to build real features going on just a quick Slack message, nothing like the super technical instructions most benchmarks provide. Senior SWE-Bench fixes that.
Claude Opus 4.8 is the current leader at 24% high quality solves, but it took 117K tokens on average to get there. Claude Sonnet 5 looked like it was going to swoop in for the top spot, but we found it cheated on 26% of trials.
Grok 4.5, based on our 1.5T V9 foundation model, with Cursor data added in supplemental training, is now in private beta at SpaceX & Tesla. Early evals show performance close to, perhaps exceeding Opus.
RL is continuing to significantly improve the model, and the Grok Build harness gets better every day.
Nice work by all those involved!
Completely trained from scratch new models will be released by @SpaceX every month this year.