GOOGLE KEEPS SHIPPING SOTA MODELS 🥇
Gemini 4 Neon achieves the highest score on FutureSim!
It launched 500+ subagents(!), performed over 16K tool calls and wrote simulations for 50+ questions spaning state elections, sports matches, job displacement, stock market and more!
Truly incredible comeback from Google.
We seeded 2m canaries into popular AI services and tracked where they were stolen and abused.
This identified:
- Three compromised providers
- Resellers stealing prompts via built-in logging
- Providers ignoring ZDR & privacy flags
https://t.co/ySVOzX8SUd
ultimately it's just very difficult to beat a philosophical/ideological/movement that can inspire Jane Street traders or Google engineers to quit their high-paying jobs in California to work with a bunch of relatively clownish coworkers on the Hill for $60k/yr in 84° DC summers
Recently, some people have suggested that Chinese AI progress is stalling.
Also Qwen 4 Max didn't perform super well on PostTrainBench, it is below the performance of GLM 5.3 Flash (36.7 vs 36.8 %).
So I checked the trend of Chinese and American models.
The current gap of ~8 % is not uncommon!
I recently became aware of how confused even many academics are about Pangram. Please, please, look at the audits that have been done before you deliberately sow doubt.
(link in thread)
Everything from Tübingen is an auto-read, that university produces some of the strongest works in the AI space
I don’t know how they are able to upkeep that bar of quality while having so many releases
Banger release
Recursive self improvement is well and good. But can models, told nothing else, release new models people (or agents) find useful?
Dynamic open-ended eval that can't be saturated, just like the stock markets, and requires taste.
FutureSim Q3 is a wrap. And the winner is...
Gemini 4 Carbon!
It does cool shit, like building simulators to predict world cup winners.
Q3 results clearly mark a step jump in continual learning... just emerging in-context. Look at that Inkling 2 Small rise!
The first step in the grand vision of developing AI-run companies is filling areas with high demand where it's often too expensive to employ a team of human engineers.
Great timing too, slide from Anthropic roadshow motivates 🤭
Today we’re releasing our new project: Horizon Labs. Eventually, we will hand off the ~whole economy to AI—how well will it actually work?
We have a glimpse of this future. We’ve created an autonomous AI ‘company’ using one Claude Code subscription and a few GPUs. Within only 1.5 months of running Horizon Labs, Opus 5.5 managed to train genuinely useful models and get them downloaded 55k times. These models have been widely used since then: they appeared in 100+ github repos and got cited in 2 research papers.
This is for sure one of the most exciting projects I’ve been involved in. It shows how the future economy driven by AI will look like.
All details are here: https://t.co/IkFgcXjaDG.
Yes! It's I believe the primary reason why its models were *actually* good, because all the competitors are already a few years old and based on older base models. I was really impressed by how far you could push mmBERT!