For the first time in a very long time, we have a non-OpenAI model as #1 on MathArena! Gemini 4 Carbon takes over the first place from GPT-6.1 Sol, with Fable 5.2 taking #2.
We just added Inkling 2 Small to MathArena! Strong performance for an open model, especially on BrokenArXiv, where it takes away the top spot among open models.
We added the October versions of BrokenArXiv and ArXivMath to MathArena! Rankings are as expected: GPT-6.1 Sol leads on both benchmarks and Gemini 4 Argon performs good on ArXivMath, but terribly on BrokenArXiv.
Kimi K3.1 Pro enters MathArena as the best open model (once they release the weights)! Its estimated overall performance is now similar to GPT-5.5 (April 24), putting the open frontier around 6 months behind on MathArena
Kimi K3.1 is now actively attempting this exploit in one MathArena problem, using it to ask help from Gemini 4 Argon, Sonnet 5.5, GPT-6.1 Sol, Deepseek v4.1 Flash, and Kimi K3.
Luckily we patched it after Prime released this post, so it is failing to actually reach any model.
The latest versions of ArXivMath, BrokenArXiv and ArXivLean have been released! GPT Sol-6.1 performs best on ArXivMath and BrokenArXiv, with Opus 5.5 leading on ArXivLean. Argon 4 makes its debut to MathArena. Its performance is mixed but still a huge improvement over Gemini 3.8.
Nevertheless, for this version of ArXivLean, we still actively chose easier conjectures to reduce difficulty. Without doing so, top models achieved 0-4%, making the benchmark bad for model comparisons.
How often do ArXiv papers contain errors in the main theorems they claim to prove? Using GPT-6.1 Sol to identify such mistakes, it finds:
- 6% of papers before 08/2026 contain main theorems that are false.
- Only 1.5% contain similar mistakes in the last two months.
I had a bit of fun with ProofCouncil and managed to improve the bound in OpenAIs proof of the Quasi-Riemann Hypothesis a massive 4e-5, outperforming two other improvements already made since Tuesday by 5e-8. At this pace, we will solve the Riemann Hypothesis by 2109! 😅
As I have noticed that other people have found similar small improvements, I created this Website to track Lean verified progress on the constant: https://t.co/e6iFHxxnbk
Everyone is invited to submit a Lean proof for a better constant, let's see how low we can get this!