Here's my 5-hour conversation with @dylan522p and @natolambert on DeepSeek, China, OpenAI, NVIDIA, xAI, Google, Anthropic, Meta, Microsoft, TSMC, Stargate, megacluster buildouts, RL, reasoning, and a lot of other topics at the cutting edge of AI. This is was a mind-blowing, super-technical, and fun conversation.
Yes, we discuss r1 and o3-mini, but more importantly we look into the future of technology, geopolitics, and humanity in a world that stands on the precipice of a global AI revolution.
The first 4 hours are here on X (4 hours is current limit), and the full 5 hours are up everywhere else. Links in comment.
Timestamps:
0:00 - Introduction
3:33 - DeepSeek-R1 and DeepSeek-V3
25:07 - Low cost of training
51:25 - DeepSeek compute cluster
58:57 - Export controls on GPUs to China
1:09:16 - AGI timeline
1:18:41 - China's manufacturing capacity
1:26:36 - Cold war with China
1:31:05 - TSMC and Taiwan
1:54:44 - Best GPUs for AI
2:09:36 - Why DeepSeek is so cheap
2:22:55 - Espionage
2:31:57 - Censorship
2:44:52 - Andrej Karpathy and magic of RL
2:55:23 - OpenAI o3-mini vs DeepSeek r1
3:14:31 - NVIDIA
3:18:58 - GPU smuggling
3:25:36 - DeepSeek training on OpenAI data
3:36:04 - AI megaclusters
4:11:26 - Who wins the race to AGI?
4:21:39 - AI agents
4:30:21 - Programming and AI
4:37:49 - Open source
4:47:01 - Stargate
4:54:30 - Future of AI
@PeladoNerd Habría que ver ahora con las compras internacionales, pero hace 6 años compramos dos de estas y siguen estando bárbaras.
https://t.co/ecnVxjISU8
¿Para qué te pegan una oblea en el parabrisas si después te piden un papel? En la era digital… ¿el efectivo no tiene la data en su dispositivo? Y con el mismo argumento de ML, el papel lo podría imprimir en mi casa!!! @gcba
Isn’t it fun when @Storyful puts a copyright claim on your livestream that we’ve worked for years to prepare for and produce? 😪 How unbelievably unfair that they’re claiming 56 seconds of our show is their content (it’s not) and now we are un-monetized 🤦♂️
IT IS OFFICIAL!!! The world’s biggest, most powerful rocket ever, will attempt its first launch on the morning of Monday, April 17th!!! We have our stream ready to go with some amazing views and incredible audio to help bring you along! https://t.co/pKpkMqrmEH
🧑⚕️🦷 If security audits are like dental checkups
🪥 test coverage is like brushing teeth
🦠Low coverage is like brushing only a few teeth 🤢
😄Good testing helps prevent and detect issues earlier, often resulting in lower costs and better fixes.
⚠️brush your teeth!
@dzapatillas Tweet dentro de 4 años: “Los 🐸 y🦎 fueron necesarias por culpa de la administración anterior. Si me re eligen traigo las🐍 venenosas y se termina el problema”
Ended up creating a separate blog for spanish. It might not be the most efficient in terms of money but hey! one can always revisit things later.
https://t.co/CucCXMBxE8
First blog post is out! Hope you enjoy it. #100DaysOfHomeLab Day 8 https://t.co/VDrf1624JQ
Decided to stop worrying about how to do a multilingual blog and just start getting some articles out in English at least. Looks like it's imposible to have content in 2 languages in Ghost