Ten years ago, we started @cerebras around an approach many believed was impossible.
As a computer architect, it is hard for me to imagine a more exciting time. Model releases are accelerating, and hardware tapeout is compressing from multi-year roadmaps to annual launches.
Hot Chips is my favorite conference, and it’s where I launched Cerebras 7 years ago. This year’s conference was especially exciting, and so much innovation was shared. I am watching the industry recreate itself: SRAM is mainstream, DRAM is moving into the third dimension, networks are being fundamentally redesigned, and AI is helping design and program the chips themselves.
The industry has never moved faster and some of the hardest architectural questions are still wide open.
Chris Sale struck out 11 Dodgers en route to his 4th career shutout
Sale on Thursday:
9 IP
0 ER
11 K
5 H
0 BB
20 Whiffs
109 Pitches
Sale topped out at 100.1 MPH, his first time reaching 100+ MPH since 2018.
ASKB, now in your pocket.
Build your morning brief, dig into breaking news or prep for your next meeting, all in natural language.
From your desk to the gym to the gate, stay in the know on the go.
Explore our AI solutions on the Bloomberg Terminal. 💡
Neil Movva (@neilmovva) started his career at Nvidia, working on GPUs and kernels, and has an unusually deep understanding of inference, from software to chips to power.
We spend a lot of time on each of those layers, how they connect, and where the important tradeoffs are.
What makes this conversation special is how detailed it is (like a 401-level class), yet Neil makes it remarkably clear and easy to follow.
Today he runs Sail Research, a company building infrastructure for agents to make tokens as cheap as possible.
We discuss:
- Latency versus throughput
- Why there are no bad chips, only bad pricing
- The end of kernel engineering
- Buying chips and power no one else wants
- New chip architectures
- Nvidia lore + his contrarian view of the company
- Open source and the frontier labs
I learned a ton. Enjoy!
TIMESTAMPS
0:00 Intro
0:38 Building a “Token Factory”
4:21 The Future of Background Agents
13:09 Nvidia and the GPU Stack
23:27 Chips, Memory, and Transformers
36:14 The Future of AI Training Data
44:32 Chip Scarcity and Compute Arbitrage
52:44 Reinventing the AI Data Center
59:01 Power and the “Scavenger Strategy”
1:10:10 Open vs. Closed AI
every chinese frontier model now uses linear attention (except deepseek)
they all use (except kimi) sparse attention with similar indexer/compression designs to maximize efficiency
they all use "fancy" residuals (mHC, attention residual, gated residual) to maximize signal propagation
they all use Muon
very exciting time for frontier (and efficient) oss models, the beauty of open research :)
GROK DECIDES. KIMI BUILDS. YOU SLEEP
one line in the morning
"build the daily market brief, 100 tickers, charts, one page"
grok makes that one decision
then hands off to a 300-agent kimi swarm
the brain never touches the work itself
38 minutes later: trigger to deliverable
296 agents online, 413 messages, 1.39M tokens spent doing it
six roles run the whole pipeline:
> dispatch, feeds, analysis, charts, verify, export - 50 agents each
that's a market brief built and shipped before you're even awake
sell that exact cycle:
> a $20-50/mo newsletter, one ticker universe, same 38-minute run every morning
> swap the topic and it's a different product - competitor teardown, earnings recap, portfolio risk - same five steps
the moat isn't the swarm
it's the one decision you wire it to make every morning
this is pure f*cking gold
andrej karpathy landed at anthropic 14 weeks ago
the "two anthropic seniors made his loop 1000x better with graph engineering" part - can't verify it anywhere, so i'm not selling it as fact
what's real and public: anthropic's own knowledge graph cookbook, and karpathy's autoresearch loop that ran 700 experiments in 2 days and found 20 optimizations on its own
i tried the graph approach on my own setup. first reply hit different
claude dropped the canned answer and actually reasoned through it
read it now, then check the article below
Today, we're kicking off the first phase of the research preview for Model Hardware Standard (MHS): a new standard for AI agents to safely operate physical equipment in scientific research and advanced manufacturing.
Read more: https://t.co/XQ2y9EW7Af
Anthropic announces MCP for hardware:
> Model Hardware Standard (MHS)
It allows any AI agent (not just Claude) to connect to lab hardware.
It's like giving your lab tools a brain, allowing AI to reach into the world of atoms.
One step closer to the cancer cure.
We have a huge news to share today!
Today we are unveiling the first truly accessible RL robot - welcome Microduck
A 25 cm tiny open-source biped with 15 actuators and packed with sensors (camera, speaker, LiDAR, NFC, bluetooth, wifi, etc) that you train yourself with reinforcement learning.
It's also playable out of the box with more than half a dozen fun and playful pre-trained policies to have it walk, sit, crouch, roller-skate, pick up objects with its articulated beak, and recover on its own.
And all for less than $400.
See all the details, play with the simulator and order it at: https://t.co/n1Btgs6vKw
(video with sound on 🔊)
Nvidia acquires Hugging Face for ~$12.9bn. But who gets the 💰? My usual breakdown below 👇
*Investors are sharing ~$7.3bn of profits on <$400m invested. A cool ~20x blended.*
*1) The single biggest winner here? Lux Capital.* 👑
Lux is taking the crown for the most $ returned in this transaction. The two rounds they led (Series A & Series C) generated ~$2.6bn combined. They also participated in the Series B.
Congrats to @wolfejosh and team. The $15.0m Series A alone will return ~132.5x the capital invested, or ~$2.0bn. The most lucrative round in absolute $ returned.
*2) Backing an exceptional team paid off with a >1,000x return for Betaworks and the angels* 📈
The story few people know: Hugging Face started life as a chatbot for lonely teenagers... You sent it a selfie and a sad emoji, it told you it understood. Quite far from where it landed!
That is why backing an exceptional team in @ClementDelangue, @Thom_Wolf and @julien_c is always the right thing to do. It paid over 1,000x for Betaworks, Kevin Durant and Thibaud Elziere.
*3) Founders and team are crushing it: not taking too much dilution along the way paid off* 👏
I estimate they will share ~$5bn in proceeds, assuming no secondary was taken along the way. A life changing outcome for them and many employees.
Taking a 15% attributed option pool at exit, this would mean ~$2bn for the team and >$3bn to share for the three co-founders. Legendary!
*4) Salesforce Ventures is cementing its reputation as one of the very best corporate VCs.* 🥇
Salesforce is adding Hugging Face to its long list of successful exits: Snowflake, Zoom, DocuSign, nCino, Auth0... Very few investors can claim as many successes, let alone corporates.
The $235m round they led returned $675m in just three short years. Meanwhile, Salesforce's own stock has been flat for the period. Capital well invested!
*5) This is a little bit of a heartbreak: but I wanted to congratulate @joinstationf here:*
Hugging Face walked into StationF as a 4-person team on day one, June 2017. Back when it was a chatbot for teenagers. They went through multiple corporate programs (Microsoft, Ubisoft, then Naver). Unfortunately they were not investing or taking equity at the time - but they contributed to making it possible. And so for that: hats off.
And of course, congratulations to all others involved: Addition, Sequoia, Coatue and many others. No one will be left out!
But is he using @tryramp ?!
Syrian President Ahmed al-Sharaa used a Visa card to pay his bill in Damascus, completing what is Syria’s first international Visa transaction in 15 years
The payment came shortly after US officially removed Syria from State Sponsors of Terrorism list a designation imposed in 1979
debating whether we should make it an official plugin, but you can try installing it here to try with these commands:
claude plugin marketplace add anthropics/claude-plugins-community
claude plugin install eli5@claude-community