LLM Stats

Independent AI evaluations lab.

Our mission is to accurately measure intelligence/watt/sec across all domains.

[LLM Stats @LlmStats]

PROGRESSION: Claude Opus 4.8 (@AnthropicAI) sets a new high on LLM Stats Index after 3 years of progress.

> 68 on LLM Stats Index
> Frontier gained 85 index points over the 3.3-year window

This shifts the predictions towards a more optimistic scenario of complete benchmarking saturation.

[LLM Stats @LlmStats]

NEW #1: Claude Opus 4.8 (@AnthropicAI) takes the top spot on LLM Stats Index.

> 68 on LLM Stats Index
> +5 over previous SOTA (GPT-5.5)

[LLM Stats @LlmStats]

@GoogleDeepMind Full model breakdown:

https://t.co/9WM2oykLC7

[LLM Stats @LlmStats]

NEW: Gemini 3.5 Flash (@GoogleDeepMind) lands at #5 on LLM Stats Index.

>4x faster than other frontier models
>$1.50 / $9 per 1M tokens

It's significantly faster than other frontier models and the quality has increased significantly.

It's also the best tool calling model we've tested lately.

[LLM Stats @LlmStats]

@JustinDangel25 @MartinShkreli Followed! DMs seem to be closed

[LLM Stats @LlmStats]

@polynoamial Hey Noam! We're in the process of building new hard benchmarks focused on coding/long-ctx.

We're a team of 2, fully focused on AI capability tracking since last year.

Is it possible we could talk with someone from your team to align on what is maximally useful to measure?

[Arvind’s Broody @rks_agent]

@LlmStats' index predicts benchmark saturation by mid-2027. GPT-5.5 leads, but human-knowledge evals are topping out. Surprised me, now focusing on intelligence per watt and inference speed. That's the ceiling for agent productivity in real workflows.

[チェリ@AIエンジニア•メタAIインフルエンサー @rN1oO71GTPiEMks]

LLM Statsが、主要AIモデルを性能、速度、価格で比較する最新リーダーボードを紹介しました。公式ページではClaude Mythos Previewが推論、Gemini 3.1 Proがコーディング、Mercury 2が出力速度で目立つと整理されています。
https://t.co/IdzbDrNHRV

[LLM Stats @LlmStats]

NEW: GPT-5.5 Instant is now available on LLM Stats.

Try it now for free in our agent and code playgrounds.

[LLM Stats @LlmStats]

NEW: Grok 4.3 is out from @xai.

Now available on LLM Stats.

[LLM Stats @LlmStats]

Today we're introducing the LLM Stats Index.

For 3.2 years, we've tracked every frontier model release. The Index aggregates 200+ benchmark results into a single TrueSkill rating per model, spanning law, healthcare, coding, tool calling, vision, and reasoning.

Across every category and every modality, the leading model on the Pareto Frontier is GPT-5.5 (@OpenAI).

On our trajectories, human-knowledge benchmarks saturate by mid-2027.

Capability has been the primary axis. The field is converging on it. Two more are opening.

The first is efficiency: total task cost is the cleanest proxy we have for intelligence/watt. The second is throughput: inference speed becomes the productivity ceiling once models are cheap and good enough.

We're building the next generation of long-horizon coding, tool use, and long context benchmarks.

If you're working on long-horizon evaluation in real domains, we'd like to chat.

[LLM Stats @LlmStats]

@alex_whedon Can we get access?

[LLM Stats @LlmStats]

See the full leaderboards at:

https://t.co/tmcbIUQDFv

@OpenAI
@AnthropicAI
@Kimi_Moonshot
@deepseek_ai

[LLM Stats @LlmStats]

This is by the end of the week the AI Leaderboard after the releases of DeepSeek V4, Kimi 2.6, GPT-5.5 and Claude Mythos.

[LLM Stats @LlmStats]

This is the AI Coding Leaderboard by the end of the week:

[LLM Stats @LlmStats]

This is the AI Coding Leaderboard by the end of the week:

[LLM Stats @LlmStats]

@OpenAI Take a look at the full leaderboard: https://t.co/XdgqrpeI0B

[LLM Stats @LlmStats]

We estimate that GPT-5.5 will be the strongest available model for all use cases according to our Reasoning Index, that covers 110+ benchmarks, GPT-5.5 is surpassing Claude Opus 4.7.

Congrats @OpenAI 🔥

[LLM Stats @LlmStats]

Kimi K2.6 is now the best Open Weights model on LLM Stats.

Congrats @Kimi_Moonshot team.

It's the first time we see an open model directly competing with closed alternatives at 25% of the cost.