the hardware lottery is also the hardware curse.
with our team, we've been pushing the boundaries of what fully local neural cellular automata models achieve on visual reasoning.
we believe this opens the door to a swathe of efficient, robust, and scalable hardware designs.
Can complex multi-step reasoning emerge purely from cells that only talk to immediate neighbors?
Happy to share our paper “Reasoning with Neural Cellular Automata (NCA)”, from our team at Google, Paradigms of Intelligence 🧵👇
Alive Maps exists in NYC. it's called @moseymaps (https://t.co/DeIcp1e6O1).
it plans the walk you'd actually want (scenic, shaded or sunny) and you set how many extra minutes it's allowed to detour.
reply with two NYC spots and I'll send back a walk worth the extra 8 minutes ↓
My AI agents found an unmapped Maya site in Mexico, using LiDAR data from a NASA dataset.
72 hours from a random thought on vacation to a reply from Mexico's national archaeology institute.
What a time to be alive…
Transformers being like "I have no idea what this is about, but I minimize cross-entropy better because I leverage every single statistical cue I spot in my flawless recall of the conversation".
check out Kunal's latest paper! understanding swarms, self-organisation, and its advantages in agentic settings is a super exciting new (...old, but renewed) frontier!
What if a swarm of AI agents could learn to work together on its own? 🐝
No leader. No roles. No turn order. Just one shared reward.
Our new paper s³: multi-agent RL lets LLM swarms self-organize, beat best-of-N, and scale past their training size!
https://t.co/c4SyIKhX7O 🧵
1/4) We're hiring in my lab, **please share**! 🚀
There are two postdoc opportunities in cog neuro and AI.
This is for a new project supported by a Schmidt Polymath Award. This project aims to build an engaging video game to collect data for neurofoundation models. 🧠🤖
1/5
Continuous diffusion may be better at discrete reasoning than standard sampling suggests.
We took SRM's MNIST-Sudoku Hard checkpoint (arXiv 2502.21075) and changed ONLY the sampler:
❗ 0.8% → 65.7% valid boards solved, without retraining. Why does standard sampling fail?🧵
Proud to share new work from our Paradigms of Intelligence team toward AI designed for decentralized hardware, where low-power communication and fault tolerance are critical requirements. Using Neural Cellular Automata (NCA), @mayalen_etc and her co-authors show that spatial locality is not a barrier to complex multi-step reasoning.
Read the full paper on arXiv: https://t.co/B3M4E9CCdb
Biology has been doing computer science for four billion years. Before the discovery of DNA, Alan Turing and John von Neumann worked out the logic of self-replicating machines, showing how matter folds into a system that reads and executes instructions to build itself.
interpretability might be the most important scientific problem in the world right now, as I don't think we can solve alignment if we don't know what we're building. I think I have good news about it. I co-authored early work in mechanistic interpretability at OpenAI and came away pessimistic, because neural networks appeared to fold into arbitrary tangled knots. years later, I started openai's first large-scale automated interpretability project, finding about 2% of neurons legible with the primitive tools we had
with modern agentic tools and a much closer look, the picture looks totally different. the vast majority in models up to trillions of parameters are legible, and their circuits beautiful. many famous examples of tangled neurons turned out to be misunderstood. The roadblocks I expected mostly aren't there. I now think ambitious interpretability will be solved by the time we need it most, and possibly quite soon, as automated scientists keep improving. it may be a bitter lesson for interpretability: the simple thing, at absurd scale, works
https://t.co/zHij5zwKGT
enabling these microbots to "walk" was largely a materials engineering breakthrough btw
quite clever to use platinum's electrochemistry to induce surface stress, and then cap with titanium to make the whole film bend
we're teaching AI to do this kind of science @periodiclabs
turns out when you have too many GPUs for your own good you can do stupid stuff such as pre-training a foundation model with constrained decoding on PTX -- that is, it does not speak natural language, it's tokenizer is PTX, it's thoughts are PTX, it's all PTX 🧵
This week marks one year since “What Is Intelligence?” was published.
It was a really fun book to write. I knew that some of the material would be dated by the time it reached readers. But I hoped that, despite rapid progress in AI, the core ideas about life and intelligence would endure. So far, so good, I think!
Hearing how you have connected with the book has meant so much. Thank you for reading, and an extra big thank you to those of you who have reviewed it, recommended it, or given it to friends.
Can an LM, starting from random init (!!), learn to generate all of its pretraining data?
Introducing Self-Play Pretraining with Zero Data. Two models start from random initialization: a generator proposes programs for a universal Turing machine and a learner trains on their outputs. We never train on any real data, but see predictable scaling on natural datasets: zero-shot val loss on images, text, audio, and melodies decreases predictably with self-play compute. And the learner develops in-context learning capabilities.
A fun proof-of-concept, co-led with @AdityaCowsik and @KfirDolev and co-authors @gbruno_dl, @ANourya@noahdgoodman, and @YoavLevine.
1/ New essay with @blaiseaguera and James Manyika at the DeepMind Institute: AGI may not arrive as one titanic mind but as societies of agents. The hard problem shifts from building a mind to orchestrating, governing, and living inside many of them. https://t.co/DINtCTeO67
The popular narrative of AGI often centers on a single, isolated super-intelligence. My colleagues James Manyika, @bratton, and I have a different model. In our new DeepMind Institute essay, we argue that the AGI transition will be a highly social event.
https://t.co/QQUl0JEeRJ
I’m beyond honoured to be named a 2026 @schmidtsciences Polymath. With US$2.5 million over five years, I’ll be able to pursue a highly interdisciplinary project that will combine quantitative and qualitative data to better capture human neurodiversity.🧠
https://t.co/kXjzjVUBEy