Are you paying attention right now?
Karpathy just open-sourced a repo where an AI agent runs its own ML research. Autonomously. In a loop. While you sleep.
630 lines of code. Every dot in the graph is a full LLM training run.
The AI picks the architecture, tunes the hyperparameters, commits the code, and starts again.
No human involvement.
You spent 6 months on a Udemy course learning to tune learning rates.
This agent does it 50 times before your morning coffee.
The guy who taught the internet deep learning just automated the researcher.
ML PhDs are about to find out their dissertation was a 5-minute training run on a single GPU.
It's over. Karpathy just open-sourced an autonomous AI researcher that runs 100 experiments while you sleep.
You don't write the training code anymore.
You write a prompt that tells an AI agent how to think about research.
The agent edits the code, trains a small language model for exactly five minutes, checks the score, keeps or discards the result, and loops. All night. No human in the loop.
That fixed five-minute clock is the quiet genius. No matter what the agent changes, the network size, the learning rate, the entire architecture, every run gets compared on equal footing. This turns open-ended research into a game with a clear score:
- 12 experiments per hour, ~100 overnight
- Validation loss measures how well the model predicts unseen text
- Lower score wins, everything else is fair game
The agent touches one Python file containing the full training recipe. You never open it. Instead, you program a markdown file that shapes the agent's research strategy.
Your job becomes programming the programmer, and this unlocks a strange new loop:
1. Agents run real experiments without supervision
2. Prompt quality becomes the bottleneck, not researcher hours
3. Results auto-optimize for your specific hardware
4. Anyone with one GPU can run a research lab overnight
The best AI labs won't just have the most compute.
They'll have the best instructions for agents who never sleep, never forget a failed experiment, and never stop iterating.
I packaged up the "autoresearch" project into a new self-contained minimal repo if people would like to play over the weekend. It's basically nanochat LLM training core stripped down to a single-GPU, one file version of ~630 lines of code, then:
- the human iterates on the prompt (.md)
- the AI agent iterates on the training code (.py)
The goal is to engineer your agents to make the fastest research progress indefinitely and without any of your own involvement. In the image, every dot is a complete LLM training run that lasts exactly 5 minutes. The agent works in an autonomous loop on a git feature branch and accumulates git commits to the training script as it finds better settings (of lower validation loss by the end) of the neural network architecture, the optimizer, all the hyperparameters, etc. You can imagine comparing the research progress of different prompts, different agents, etc.
https://t.co/YCvOwwjOzF
Part code, part sci-fi, and a pinch of psychosis :)
@AnamarijaML @garrytan The point is that this money is not castles, banquets and courtesans but the machines that produce goods, services, innovation, employment and tax revenue. Dismantling these machines to sell them to pay taxes makes everyone worse off
Boom!
Grok 4 Fast now has a huge 2M token context window!
Why is this important?
This context window can allow substantially documents or code bases to be loaded as a single prompt for interrogation and consideration.
With the added bonus of being insanely fast with almost no memory leakage.
I am running test this morning that are quite mind blowing. More soon.
I’m not big on identities, but I am extremely proud to be American. This is true every day, but especially today—I firmly believe this is the greatest country ever on Earth. The American miracle stands alone in world history.
I believe in techno-capitalism. We should encourage people to make tons of money and then also find ways to widely distribute wealth and share the compounding magic of capitalism. One doesn’t work without the other; you cannot raise the floor and not also raise the ceiling for very long.
The world should get richer every year through science and technology, but everyone has to be in the “up elevator”. I think the government usually does a worse job than markets, and so we need to encourage our culture of innovation and entrepreneurship. I also believe that education is critically important to keeping the American edge.
I believed this when I was 20, when I was 30, and now I am 40 and still believe it. The Democratic party seemed reasonably aligned with it when I was 20, losing the plot when I was 30, and completely to have moved somewhere else at this point. So now I am politically homeless. But that’s fine; I care much, much more about being American than any political party.
I’d rather hear from candidates about how they are going to make everyone have the stuff billionaires have instead of how they are going to eliminate billionaires.
The American experiment has always been messy. I am hopeful for another great 250 years. Happy 4th!
the chatgpt launch 26 months ago was one of the craziest viral moments i'd ever seen, and we added one million users in five days.
we added one million users in the last hour.
Congratulations Sriram @sriramk! This appointment is a 1,000x upgrade for the US government, and puts the US firmly in the driver's seat for AI policy globally. Sriram is the right man for the topic and the time. It's Morning in AImerica! 🔥💪🇺🇸
Sam Altman is a hero of mine. He built a company from nothing to $90 Billion in value, and changed our collective world forever. I can't wait to see what he does next. I, and billions of people, will benefit from his future work- it's going to be simply incredible. Thank you @sama for all you have done for all of us.
The magic incantation for workplace conflict
If you ever find yourself:
1. Taking 20+ minutes to compose a 2-sentence Slack response
2. Taking 1+ hour to respond to an e-mail
3. Raising your voice in a meeting
It’s time to use the the magic incantation:
"Let’s continue this tomorrow."
You can tack on a "I’ve got more to say but..." or "I don’t think we can resolve this today..." or even "I’m not feeling my best..." before the magic incantation, but use the incantation.
You can’t solve conflict when you’re seeing red.
You’ll probably make it worse if you keep at it.
Let the moment pass.
Go for a walk. Get a good night’s sleep.
It will be easier tomorrow.
The digital asset market continues to post impressive performance, with $BTC and $ETH appreciating meaningfully against USD and gold.
#Bitcoin dominance also continues to rise, outpacing traditional and digital assets.
Read more in our latest analysis👇
https://t.co/e2Js9FinHY