„Europe wants to become the first AI Continent.“
They can't be serious, can they? This has to be a joke, right?
Completely out of touch with reality.
Absurd.
Very bad response…
Use the API properly, otherwise your bench gives bad scores, and makes you untrustworthy.
Deleting thoughts is literally bad engineering, now feels hard to take your benchmarks seriously.
OpenAI’s internal testing shows that provider-managed conversation state preserves greater continuity across turns and improves performance on long-horizon tasks like ARC-AGI-3. This is a real and useful result. We’re encouraged to see ARC used to identify useful harness design.
ARC’s verified scores use a “no harness” approach to avoid accidental or intentional developer-aware targeting and to fairly compare scores across all providers. All systems receive the same observations, system prompt, and operate under the same action limits. Conversation state is managed client-side using the industry-wide standard interface for LLMs (the OpenAI-style completions API).
We want progress on ARC to reflect true AGI progress, not ARC-specific format training or settings, and we’re actively working with several industry labs, including OpenAI, to figure out how to best incorporate these server-side state management findings into our verified testing setup while remaining fair and consistent across providers.
The line “explicit counter example to jc?!?! Impossible. Find it! Find it!” Are basically the experts inside the model having internal dialogue and debates.
Using moe and rl’ed models drives this type of behavior. Always nice to see it.
Germany has launched one of the world's best open-source AI models.
Soofi S, made by the Soofi consortium, is a 30B parameter model fully trained in Europe and tops the ranking for open-source AI.
Huge moment for Europe, and finally some competition for Chinese open-source AI.
"Let me stop here. You're right, and I should have checked with you first. This deserves a proper investigation, not a guess as to why I just nuked 3 continents."