Hot take: The compute credit crunch is not real and Elon is fearmongering.
I see no slowdown in my non-IG pipeline (deals under $500M mostly)
Real issues:
- Higher interest rates
- Supermicro delaying all their deliveries
Wrong here man, if you believe that token consumption will continue to skyrocket and plugged in GPU’s are going to be constrained, anyone with a ton of air cooler B300s will do great for the next few years, modular liquid cooled is becoming easier & within 12 months will make any DLC deployment easy
Don, there is a missing term in your equation.
The crunch spread is not: Token Price - GPU rental price.
Rather it is: (Token Price * Token Volume) - GPU rental price.
More simply: Revenue per GPU - GPU rental price.
Continuous throughput improvements for the same exact token mean that volume growth can more than offset token price declines for the exact same model/token
i.e. Kimi K3 token throughput per GPU has recently been improving at a 37% annualized rate driven by inference engine optimizations.
GPU prices are vertical because:
1) Mix is shifting from higher margin frontier tokens to lower margin open-weight tokens. $10 in Claude revenue requires $1 of inference compute. $10 of of open-weight revenue requires $3 to $7 of inference compute given competition between inference providers leads to lower margins. Open-weight tokens taking share is positive for AI infrastructure demand given lower margins at the model layer. The reverse is also true in that frontier tokens taking share is negative for AI infrastructure demand. Open-weight models have been taking share since early summer.
2) Throughput is steadily improving for each individual token type such that GPU compute becomes more valuable even as true like for like token prices decline.
The best way to make friends as an adult: Sign up for a new side quest. It could be a race or competition. Maybe a hiking adventure. Or some new creative hobby. Really whatever. It opens your life to an entirely new community of people. People you’d probably never have met or interacted with otherwise. Suddenly you have a shared mission. Group chats form. Daily texts start flying. Regular get togethers happen. Tons of new energy breathed into your life. I think we all need some Side Quest Friends. Sign up for that thing that scares you a little bit. Watch your whole life improve.
My goodness
@TexasFootball using @snowpatrol ‘Lightning Strike’ as the musical choice for this cinema.
Whichever person in the media department chose this song deserves a raise, tonight 🤝
Tuesday 8/25
‣ San Francisco n8n Community Meetup with n8n Founder & CEO Jan Oberhauser https://t.co/adY9tp8zWg
@n8n_io@Willie_Nganga84
‣ {AI} in Production with Inngest, Nebius Token Factory, & Flox\ https://t.co/GlZeGqg2dn
‣ Turning Your Build Process Into a Content Engine by Obvious, Ordinal & Speakeasy https://t.co/GzklxniKsD
@obvious@sagar_batchu@dboskovic
‣ AI Infra Sellers Meetup #6 https://t.co/cmevDCNts1
@joseph25009@montanathestate
‣ AI-pilled teams: Multiplayer demos https://t.co/M5BLPQXjRk
‣ Mistral Meetup with SGLang and Hugging Face https://t.co/UyRVD48zV8
@MistralDevs
‣ Physical AI: What's Working (and What Still Breaks) https://t.co/3vwxvG8oWS
@leecflannery@asimahmed
‣ Embodied AI Night: Founders, Builders, and Researchers https://t.co/F369PAvKJe
@matthewwon24755@nathanqyu@FusionFundVC
‣ Cool Chips - Hot takes https://t.co/fvMh3Zngz1
@rhatr@dadarstan@AIFoundryorg
‣ Corey Quinn x Philip Kiely @ Natoma Cabana https://t.co/RTcgrYBIpe
@basetenco @philip_kiely@Quinnypig
C.S. Lewis wrote about this in an essay called First and Second Things. He said that paradoxically, you're more likely to get what you want when getting it isn't the most important thing in your life. If you put the highest thing first, you'll often get the second thing as well. Put the second thing first, and you'll lose both.
My seventh conversation with @GavinSBaker.
It's about the gap between what the market is doing and what companies are seeing. It's been a tough month or so for public AI names, but there's no sign of a slowdown on the ground in Silicon Valley.
We discuss:
- Why old GPUs are getting more expensive
- Open source vs the frontier
- Claude as Wall Street's Walter Cronkite
- Whether the buildout gets funded out of cash flow or debt
- SpaceX as a data center company
- And more
Enjoy!
TIMESTAMPS
0:00 Intro
1:17 AI Selloff vs. Fundamentals
10:20 Financing the AI Buildout
18:18 GPU Prices Keep Rising
24:23 Claude Moves Markets
29:01 What Could Break the Thesis
36:59 The Memory Supply War
42:08 Nvidia’s New Playbook
50:14 China and Open Source
61:51 Data Centers and Regulation
71:11 SpaceX and Orbital Compute
I’m convinced that intelligence is overrated.
Intelligent people are more likely to overthink, overplan, and overanalyze. They hide behind motion that doesn't create progress. They fear the judgment of others if they're proven wrong.
The truth is that intelligence is abundant. Especially now. AI is making it a commodity. Courage is not. And it can’t be replaced. The people you admire are the ones who had the courage to act. They aren’t more talented than you. They aren’t smarter than you. They just took action when you didn’t.
I often wonder how many extraordinary people wasted their entire lives waiting for permission that never came. Permission isn't granted. Permission is taken. You get to tap yourself in whenever you want. You can just do things.
Courage beats intelligence. Remember that.
A series of fairly wild thoughts from Dwarkesh. I thought I was bullish but even I am not assuming that the price to rent compute continues to go up!
I will say that I am in SV this week and Dwarkesh is capturing the zeitgeist.
Net, net public markets would probably be trading differently if they saw the OpenAI, Anthropic, Grok/Cursor and Open Source numbers over the last 6 weeks.
And really good for anyone who has installed compute coming off contract and/or is bringing on compute that is not already contracted. And credit slowing down capacity adds - if it happens - only exacerbates all of this.