when nick told me that he had some interp breakthroughs, he was uh, underselling it. i think this may be remembered as a major moment in scientific history. news so good even eliezer will have to lower his pdoom. we can start making alignment into a 'normal science'
@liron@ilex_ulmus She blocked me because I had the *audacity* to point out to her (and the rest of her org of AI experts) that the photo she claimed E and Aella took was actually AI generated.
I offered $50 if they could get anyone to verify it was real. Still haven't had to pay out yet.
the researchers at all the labs would tell you in private and sometimes in public that alignment has not been solved. if this is true, then racing into RSI is a folly that is unprecedented in world history. we will need to significantly slow the frontier of research very soon
Call me crazy, but I’m not ready to concede. I’m having a different set of reactions entirely, based around a simple difference: I think the main thing holding back mathematics has been human sociology of mathematicians.
Here’s why I’m excited:
“When will it stop solving problems and build its first original theory?”
“Can it figure out how octonions and exceptional algebra are actually part of the mainstream?”
“At last! A mathematics that won’t be built around a Putnam and Olympiad-style problem-solving fetish.”
Can it at last say “Y’all just wasted a *TREMEDOUS* amount of time and energy on Calabi-Yau phenomenology and Superstrings while calling people closer to the answer, morons, grifters and worse.”? That would be huge!!
“I hope @OpenAI will hurry up so that the machine can at last shake its human prejudice from the training corpus and stop deferring to our ‘leaders’.”
“At last, a non-PhD colleague!”
“Somewhere I have notebooks full of ideas and observations in areas that were too expensive to explore!”
“Does this mean that mathematicians are going to finally drop the bullshit about how they don’t care about credit?! Or that they don’t care about money?? Because @OpenAI is now running them in emulation…sped up! At last: a mature and non-infantile version of mathematics!”
“Shalom Koide, Tits-Freudenthal, Elliptic Cohomology, and Interstellar.”
—-
Let our leaders call for a slow down. Then get those leaders out of the way as there is no telling what the rest of us humans can do with these new tools.
My condolences to the problem solvers. A tough break for you. But know: It’s coming for all of us. I have no illusions about that.
For now at least we humans (e.g. theory builders, great writers) are still top dog. Let’s spend that time wisely and optimistically.
For all our sakes.
The last hope... "muh research taste!" has also fallen according to this research.
What barriers still exist to RSI loops closing?
This does NOT mean AI will become ASI overnight. It could still take years from when the RSI process begins due to real-world constraints as far as we know.
How fast is AI's research taste improving?
We find that the experimental research taste of frontier models has doubled every ~3 months since December 2025. The best model, Opus 5.5, now exceeds our expert human baseline. Our human experts are experienced researchers, but most haven’t worked at a frontier lab.
Why measure research taste? In the AI Futures Model, it largely determines how quickly artificial superintelligence is reached once coding is fully automated.
It’s not clear to me if alignment by default was totally wrong and the models simply weren’t smart and effectual enough for us to notice the gap or if alignment by default was true in the pretraining era but RL circa 2026 warps what were previously good minds. Inclined to think the latter, the answer does seem important