@nothingto12 Yes, that makes total sense. But my point is, if on top that they offer something similar to, let's say, Ollama ($20 --> $60), that would mean some extra millions that are not going to the competence anymore.
I'm sure they have a reason for not offering it, and, as you said,
Fuck you, @ArtificialAnlys
Your new index says Claude Haiku 5.5 is smarter than DeepSeek V4.1 Flash 1017 and GLM-5.3.
Haiku is Anthropic's small cheap model. DeepSeek 1017 is the model Cursor put on its cost frontier this month, and Cursor says no model scores higher at those prices. I run it every day on my 4x 3090. I dont believe for a second that Haiku beats it.
Look at how they got there. 60% of the index now runs on private tests nobody outside can see. GDPval-AA, SciCode and the long context test are gone. In comes a private coding benchmark from Cognition. And the open weights gap goes from 3 points to 12 in 1 release, 4x. Released open models are now 26 points behind the top.
1 day before v5, on the old version, they gave Ling 3.1 Flash 1019 a 44. Now the best released open model gets 32.
The weights didnt change. The tests did, and you cant see the tests.
This is a bought benchmark. A leaderboard where you cant check a single question, that widens the gap 4x overnight and puts Haiku above DeepSeek, is marketing for closed labs. Its not measurement. I hope at least you were paid enough money to publish such garbage. Liars.
Publish the questions or stop calling it an index.
@gonsanchezrey1 Estamos de acuerdo en que aún hay que ser cautelosos, no? Y guiarnos por acciones/resultados mas que por personalidades.
https://t.co/5yhQ2CxOOg
@JovenPangolin@armesillaconde No es tratado de defensa mutua, es de coperación.
Pero vamos, no es algo menor... muy turbio de todas formas. Gracias por compartirlo.
@nothingto12@CommandCodeAI Bro, please keep including Command Code. Right now they're one of the big players in the scene, and the goal isn't to advrtise or bash them; its just to get the truth about their service quality.
Sorry for them if doesn't help
You're really helping the community with this, btw!
@Menteenblanc01@armesillaconde Bueno, no sabemos eh... El cuento de los bandos enfrentados es conocido, pero la ambición de estos tipo tampoco conoce límites.
Las internas de poder ocurren hasta dentro de las familias. Yo no lo descartaría aún.
@opencode New test.
To be fair, here it performed much better:
https://t.co/HtAi1PS6Fp
The price benefit you offer is worth that tiny difference in cache rate/throughput performance.
🧵 Round 1 - DeepSeek API vs OpenCode Go vs CommandCode GOAT
Finally here! This time, you're able to view the demos yourselves and judge.
https://t.co/VOjMdbIW7H
NOTE: The run for CommandCode GOAT failed on me after many retries. Still, it did produce working code at the end.
BREAKING: After being exposed for bankrolling politicians, JEWISH @AIPAC is changing tactics.
Instead of donating through its PAC, it’s recruiting individual donors to send cash DIRECTLY to politicians.
@grok Start with TRUE or FALSE.