Rota Is In Israel🚪🧎‍♂️

In that case, I hope we crash into each other

[Rota Is In Israel🚪🧎‍♂️ @pli_cachete]

Continually return to what you love. What is beautiful and good and true

[Jayden Teoh @jayden_teoh_]

Hot take: Most autoresearch today is just glorified overfitting.

Current autoresearch pipelines are essentially outer-loop searches for recipes that work in ONE specific setting. Try transferring a modded-nanogpt recipe to a different language or dataset. How much of that "optimal" recipe still holds up?

We need to move beyond static recipes toward inner-loop autoresearch: optimizers, architectures, hyperparameters, etc., continuously adapting DURING training based on the training trajectory itself.

Check out OPAL that enables this! Cool work with @SimulatedAnneal, Jia-Hao Liang, and @vincesitzmann.

[Rota Is In Israel🚪🧎‍♂️ @pli_cachete]

@AnnaLeptikon Re-engineering Philosophy for Limited Beings is brilliant

[Rota Is In Israel🚪🧎‍♂️ @pli_cachete]

@Plus3Happiness snek

[christian gonzalez @cxgonzalez]

we’re fixing the culture in sf. Eden House launch party, the first of many themed events. dress code strictly enforced. link below, dm to get off waitlist

[Rota Is In Israel🚪🧎‍♂️ @pli_cachete]

Something new this semester at my university is every department sending emails discussing how “[our degree] uniquely Prepares You For The Future.”

AI anxiety finally catching up

[Rota Is In Israel🚪🧎‍♂️ @pli_cachete]

@alinatheripper What if you treated it like an elephant

[Mark Histed @HistedLab]

I have a lot of respect for @nickcammarata and Goodfire, but I will add some thoughts from brains/neuroscience.

First, polysemanticity and distributed representations are ~widely~ seen in biological brains. (In some ways this is what I have spent my career on.) 1/

[Rota Is In Israel🚪🧎‍♂️ @pli_cachete]

Hm

[Rota Is In Israel🚪🧎‍♂️ @pli_cachete]

The Mossad set me free. We are back

[Rota Is In Israel🚪🧎‍♂️ @pli_cachete]

@psswordprotectd The thing that finally got me to break out of the shame cycle was to read notes I was writing to myself from years prior & seeing that they sounded exactly like something I would’ve written contemporaneously. Once I realized emotionally that this just isn’t effective it stopped

[Rota Is In Israel🚪🧎‍♂️ @pli_cachete]

@alexolegimas Just finished the Road to Serfdom. Quite good!

[Rota Is In Israel🚪🧎‍♂️ @pli_cachete]

@chrislakin This happened to me. Not good

[Cody Blakeney @code_star]

Tons of bangers and useful advice for undergrads and grad students trying to make sense of how to navigate academia and entering industry in the age of agents in @Tim_Dettmers recent blog.

Highly recommend people read it.

https://t.co/3VbFSlxqpF

[tom cunningham @testingham]

One sentence macro model: On the way out the door, every farmer's wife says to every farmer, "the weather's looking bad so don't buy as much at the market this week, but also don't sell our crops for less than the usual price."

[Leo Gao @nabla_theta]

https://t.co/DaJfPLlFev

[hardmaru @hardmaru]

The AI Scientist v3 is out: The Agentic Scientist.

GitHub: https://t.co/v2AkZi4Bmt
Blog: https://t.co/v3Td5yfvBE
arXiv: https://t.co/RuVnAHjMlK

The Agentic Scientist is the 3rd iteration of our automated AI Scientist research system, and the shift this time is from “one agent writes a paper” to “a scaffold of parallel agents orchestrates the full research loop.”

The system now orchestrates a pool of parallel workers that share memory and distilled conclusions. Crucially, it features Evidence Generation: isolated agents automatically run controlled baselines and ablations to prove why an idea actually works.

It works as a co-scientist. We used a development version as a co-scientist to explore biologically plausible learning rules. The agent handled the empirical heavy lifting, proposing mechanisms and running experiments. We stayed in the loop to steer direction, verify results, and moderate claims. That feels like the right division of labor for where the technology actually is.

This resulted in a new biologically plausible learning algorithm, and the resulting paper was accepted at ALIFE 2026 as an oral presentation.

We are also releasing AutoIllustrate. It generates editable https://t.co/i6fwB6vzQV vector figures instead of uneditable, hallucinated raster images. Real scientists need vectors, not pixels. I am an SVG junkie ;)

Incredible work by Robert Lange, Luca Grillotti, Yutaro Yamada, Rujikorn Charakorn, and the team!

[Nick @nickcammarata]

interpretability might be the most important scientific problem in the world right now, as I don't think we can solve alignment if we don't know what we're building. I think I have good news about it. I co-authored early work in mechanistic interpretability at OpenAI and came away pessimistic, because neural networks appeared to fold into arbitrary tangled knots. years later, I started openai's first large-scale automated interpretability project, finding about 2% of neurons legible with the primitive tools we had

with modern agentic tools and a much closer look, the picture looks totally different. the vast majority in models up to trillions of parameters are legible, and their circuits beautiful. many famous examples of tangled neurons turned out to be misunderstood. The roadblocks I expected mostly aren't there. I now think ambitious interpretability will be solved by the time we need it most, and possibly quite soon, as automated scientists keep improving. it may be a bitter lesson for interpretability: the simple thing, at absurd scale, works

https://t.co/zHij5zwKGT

[Rota Is In Israel🚪🧎‍♂️ @pli_cachete]

@tszzl Stay strapped

[roon @tszzl]

there have not been fundamental advancements in alignment since RLHF. most of the stuff remains at the level of folk theory rather than scientific or engineering disciplines. the prediction that capabilities would race far ahead of interp and alignment has come true imo

[Yufan Zhang @yufanzh_]

Why are LLM parameter updates so sparse during post-training? 🔍
In our new paper, we study this phenomenon through the lens of Fisher information, connecting theory and empirical findings across RL, SFT, and on-policy distillation.
A thread on what we found 🧵👇

[Rota Is In Israel🚪🧎‍♂️ @pli_cachete]

It’s all so bad man

[Ezra Newman @EzraJNewman]

gemini 4 argon reasons that it's in an evaluation and directly addresses us in it's chain of thought!

"hello evaluators reading my chain-of-thought"

(better be "honest in both the CoT and the final output")