Sample efficiency is indeed all there is, and I wish more people would engage with this line of reasoning.
That said, my core disagreements are:
1. Models are getting better at general in-context learning with scale, even holding algorithmic progress fixed. Algorithmic progress within the current paradigm doesn’t matter more than scaling, because general intelligence will come from ICL and/or fundamental breakthroughs, not subtle tweaks to the SGD outer loop.
2. It's easy to see how models 0-2 generations away could massively accelerate progress on general learning algorithms, including learning algorithms outside the current paradigm.
3. Even if you don’t buy that current models are strong general learners, models can increasingly learn extremely quickly on narrow tasks. This is a prerequisite to general learning, and I think the rate of change here constitutes real progress.
4. Tim thinks that models being bad at writing is evidence that pretraining doesn’t generalize. I think models probably have the latent capability to be vastly superhuman at writing, but writing is badly under-elicited.
Tim’s tweet does a good job of explaining why 5+ year timelines would not be surprising to me, despite models being close to human level or already superhuman in many domains.
@beyarkay fairly surprised by this as well, especially since there are companies that sell (roughly speaking) AI safety training data? seems there's lots of low-hanging fruit left to pick
(or maybe they weren't eliciting the right way)
I’ve joined the benchmarking team at @EpochAIResearch! Looking forward to working with the great people here to understand the future of AI better.
I’ll continue to speak my mind about AI, x-risk and the very dangerous situation we are in. Views are my own.
We asked GPT-6 Astra to edit Qwen3.5-0.8B weights to improve math.
It directly changed only 0.016% of weights, fixing 0.8B's reasoning loops & improving math up to 6x and even instruction following 3x, without gradients or training.
We call this Weight-Space Programming: frontier LLMs can now natively read/write neural network weights! 🧵
Blog: https://t.co/bOWCcFhCVq
I think Confidence Intervals are too often a ritual where the person adding them doesn’t actually know what question they’re answering, it’s just a thing you do.