Opus 5.5 has been nerfed? Confirmed ๐คฏ
Everyone was talking about it yesterday, so I tested it myself.
Same prompt. Launch โ Oct 3 โ today. Worse every time.
And it burns tokens faster. ๐ฑ๐คฆ
Kimi K3.1 Pro vs. DeepSeek V4.1 Flash vs. MiniMax M3.1 Flash โ๏ธ
Everyone says Kimi K3.1 Pro is beating Opus 5.5 on some benchmarks.
In my test, on MAX, it couldn't even beat DeepSeek V4.1 Flash on xhigh. ๐
At 49x the price. ๐คฏ
Kimi: $24.12
DeepSeek: $0.49
MiniMax: $0.23
Am I wrong? ๐
Kimi K3.1 Pro vs. Claude Opus 5.5 โ๏ธ
Round 2: the Alpine Gold benchmark. One on one this time. ๐๏ธโ๏ธ
Kimi did better than on the Lighthouse. ๐
But it's still far from Opus 5.5.
And that's Kimi on max vs. Opus on xhigh. ๐คฏ
Kimi K3.1 Pro: $24.12 ยท 1h 12m
Opus 5.5: $31.85 ยท 2h 45m
So be honest: can Kimi K3.1 really compete with Opus 5.5? ๐
@sitalump Fair point on the sample size ๐ I still preferred DeepSeekโs result here, and that roughly 49ร gap in estimated cost is hard to ignore.
Kimi K3.1 Pro vs. Opus 5.5 vs. GPT-6 Astra
Everyone says Kimi K3.1 Pro matches Opus 5.5 at a fraction of the price.
My Lighthouse test on max: $23.42
I had to use max. On high it was 10x cheaper, but the results were closer to Muse Spark 1.3. ๐
Opus: $53. GPT-6 Astra: $42. Kimi lost to both. ๐คฏ
What am I missing? ๐
Testing it on the Eiffel Tower and the Space Train next. Results soon.