Katherine Hermann

Research Scientist @GoogleDeepMind | Past: PhD from @Stanford

[Rep. Emanuel Cleaver @repcleaver]

More than 3 million Americans are impacted by Celiac Disease in the U.S., forcing them to maintain a careful diet or face serious health challenges that come with the disease.

I introduced the Celiac Safety Act to update our labeling laws and protect these Americans.
https://t.co/f4fBxExExy

[Andrew Lampinen @AndrewLampinen]

Pleased to share that our paper "Representation Biases: Variance is Not Always a Good Proxy for Importance" is now out as Theory/New Concepts paper in eNeuro! Thread:

[Eghbal Hosseini @eghbal_hosseini]

How do diverse context structures reshape representations in LLMs?
In our new work, we explore this via representational straightening. We found LLMs are like a Swiss Army knife: they select different computational mechanisms reflected in different representational structures. 1/

[Katherine Hermann @khermann_]

@ermgrant @tweetsatpreet @UAlberta @AmiiThinks @CogInterp @DataOnBrainMind Congratulations, Erin 🎉

[Goodfire @GoodfireAI]

LLMs memorize a lot of training data, but memorization is poorly understood.

Where does it live inside models? How is it stored? How much is it involved in different tasks?

@jack_merullo_ & @srihita_raju's new paper examines all of these questions using loss curvature! (1/7)

[Ilia Sucholutsky @sucholutsky]

🧵🎉 Our mega-paper is finally published in TMLR! We're "Getting Aligned on Representational Alignment" - the degree to which internal representations of different (biological & artificial) information processing systems agree. 🧠🤖🔬🔍 #CognitiveScience #Neuroscience #AI

[Michael C. Mozer @mc_mozer]

[1/4] As you read words in this text, your brain adjusts fixation durations to facilitate comprehension. Inspired by human reading behavior, we propose a supervised objective that trains an LLM to dynamically determine the number of compute steps for each input token.

[Katherine Hermann @khermann_]

@drjuliashaw @AdamRutherford Congratulations, @drjuliashaw! Can't wait to read it!

[Andrew Lampinen @AndrewLampinen]

Many representational analyses (implicitly) prioritize signals by the amount of variance they explain in the representations. However, in https://t.co/NgjqF8Chzs we discuss results from our prior work that challenge this assumption; variance != computational importance.

[Andrew Lampinen @AndrewLampinen]

In neuroscience, we often try to understand systems by analyzing their representations — using tools like regression or RSA. But are these analyses biased towards discovering a subset of what a system represents? If you're interested, check out our new commentary! Thread:

[Aran Nayebi @aran_nayebi]

🚀 New Open-Source Release! PyTorchTNN 🚀

A PyTorch package for building biologically-plausible temporal neural networks (TNNs)—unrolling neural network computation layer-by-layer through time, inspired by cortical processing. PyTorchTNN naturally integrates into the Encoder-Attender-Decoder (EAD) architecture (Chung*, Shen* et al., 2025), which flexibly combines diverse neural networks, motivated by the fact that no single model (Transformer, SSM, RNN) dominates all sequence learning tasks.
🧵👇

[Aran Nayebi @aran_nayebi]

Our first NeuroAgent! 🐟🧠

Excited to share new work led by the talented @rdkeller, showing how autonomous behavior and whole-brain dynamics emerge naturally from intrinsic curiosity grounded in world models and memory.

Some highlights:
- Developed a novel intrinsic drive (3M-Progress) that better matches the reliable autonomy of animals

- First task-optimized model of neural-glial computation

- Surprisingly, no linear regression needed: a simple 1-to-1 mapping was enough to pass the NeuroAI Turing Test on whole-brain zebrafish data (~130,000 recorded units), provided you have the right intrinsic drive of course!

Check it out! 👇

[Katherine Hermann @khermann_]

@ElizaKosoy Congratulations, Eliza! 🎉

[Andrew Lampinen @AndrewLampinen]

How do language models generalize from information they learn in-context vs. via finetuning? We show that in-context learning can generalize more flexibly, illustrating key differences in the inductive biases of these modes of learning — and ways to improve finetuning. Thread: 1/

[Kelsey Allen @KelseyRAllen]

Humans can tell the difference between a realistic generated video and an unrealistic one – can models?

Excited to share TRAJAN: the world’s first point TRAJectory AutoeNcoder for evaluating motion realism in generated and corrupted videos.

🌐 https://t.co/ytEmuAPcYa

🧵

[Katherine Hermann @khermann_]

@DynamicWebPaige For CA: Mount Langley (Southern Sierras) and Mount Tallac (Desolation Wilderness) are both really nice

[Katherine Hermann @khermann_]

Congratulations, Lukas! 🎉

[Lukas Muttenthaler @lukas_mut]

This past Friday I successfully defended my PhD 🎉🙏🏼 What a journey it was! 4.5 years of many ups and many downs. Can’t believe it’s over. I am still processing…

Special thanks to my wonderful committee KR Müller, @martin_hebart, @cpilab, and @scychan_brains!

[Thomas Fel @thomas_fel_]

Train your vision SAE on Monday, then again on Tuesday, and you'll find only about 30% of the learned concepts match.

⚓ We propose Archetypal SAE which anchors concepts in the real data’s convex hull, delivering stable and consistent dictionaries.

https://t.co/iaX60GZt0o

[Aran Nayebi @aran_nayebi]

Had a lot of fun speaking with @avileddie about the practical challenges of scaling (especially in Embodied AI), NeuroAI, what to expect in the future, and advice for students getting into the field.

Check it out here!
https://t.co/HGaC6IwMRs

[Aran Nayebi @aran_nayebi]

1/ 🧵👇
What should count as a good model of intelligence?

AI is advancing rapidly, but how do we know if it captures intelligence in a scientifically meaningful way?

We propose the *NeuroAI Turing Test*—a benchmark that evaluates models based on both behavior and internal representations.

👉The key principle: given a metric, models should be *at least as good as brains are to each other*: