INSIDE @odysseyml, the $1.45bn world model lab, w/ Co-founder & CEO Oliver Cameron (@olivercameron)
Compute deals agreed on a handshake disappeared the next day.
"Deals that we had handshaken were the next day disappearing."
Odyssey raised a $310mn Series B in June, with @amazon and @AMD in the round. It trains across @nvidia, @awscloud Trainium and AMD chips.
"I think there's equally a case to be made that it will actually get dramatically worse, that compute will become more scarce, will become more expensive, more constrained."
We cover:
› How @OpenAI and @AnthropicAI raising huge rounds squeezed compute for smaller labs
› Why the Series B became a search for compute partners
› How coding agents make models portable across chips
› Robot data is abundant now. 3 of Odyssey's 10 to 12 vendors would start an unusual request the next day
› World models as training environments and data generators
› The Voyage lesson: solve the hardest version of the problem first
TIMESTAMPS
00:00 What is Odyssey-3, a foundation world model?
02:05 Why task-specific robot data hits a ceiling
04:50 Driving in India: one researcher, results of a 500-person team
06:57 20 hours of blocky simulation vs 30 hours of real driving
09:21 Flexion, post-training and why robot companies stop building everything
11:45 Poke & Wiggle (@pokeandwiggle): real-robot evals as a test suite
15:15 World models vs language models: 14B parameters vs a 5T rumor
18:48 What it takes to scale world models
21:37 Egocentric video and the data mixture
23:33 Is any robot data still hard to find?
25:26 World models as the ultimate RL environment
27:30 When compute became existential
29:29 Fundraising as a compute partnership search
31:44 A hybrid fleet: NVIDIA, Trainium and AMD
33:13 Coding agents and CUDA lock-in
34:18 What is a robot company's moat?
36:17 A short memory for pain
37:55 The Voyage lesson: solve the hardest thing first
Odyssey-3 is the best-performing world model...in the world!
It scored highest on World Models' Last Exam in Physics, and remains SOTA on Physics-IQ Verified.
These physics gains translate into more capable robots, humanoids, AVs, drones, and simulations.
World models like Odyssey-3 can now simulate general environments with far greater physical accuracy, all in real time.
The knowledge learned by models like Odyssey-3 can also power robots, humanoids, driverless cars, and drones.
And world models are just getting started!
We placed the fruit fly brain inside Odyssey-3, a frontier world model.
The lil’ guy is now flying around totally imagined, simulated worlds all by itself 🫶
Today we're launching Odyssey-3, the most powerful foundation world model yet.
It sets a new state of the art on Physics-IQ, and powers robots, trains AIs, and generates interactive experiences. It's really cool.
Experience the model today, all for free!
Not everyone earns a US $, #1 thing that worries me about Cohort Based Courses is premium-ish pricing. I understand the value prop, it is about student transformation & it takes a lot to put together every bit of course.
I don’t know who needs to hear this but #1 skill for course creators is to develop strong emotional connection with your students from day 1.
Reconnected with one of my students after 4.5 years. I’m so excited to meet many of my former students in today’s ZOOM class!
CBCs are applying the same concept of community that has made education tick for generations: learning together, in community, in real time, with everyone contributing, to the online environment.
I say, CBCs are nudging education innovation, read more: https://t.co/CZ1PtKk8NA
Why I am bullish about the future of education?
✔️The best teachers will be celebrities.
✔️Beginning of the lifelong learning era, you can't fill your knowledge tank up until the age of 25 & drive off through life.
✔️ The community provides what content alone lacks.
Reflections on the 'art of creating transformational learning experiences' from two amazing teaching years @TeachForIndia. Might help emerging cohort-based course creators, teachers, and instructors out there.
Tune into @teamteacherly latest podcast episode, where I share my insights on 1. Why educators need to collaborate more than ever before? 2. Ideas on collaboration models 3. Quick tips for educators on how to adapt