4/4: Abstraction helps the model ignore noise and focus on the one key factor in an environment.
For complex tasks, a step by step structure works best: set a verifiable reward at each step, just like how humans solve difficult problems.
1/4: Is reinforcement learning the right path to AGI?
After watching the Silicon Valley 101 discussion, one point stood out: with a high quality simulator and a rich reward system, RL can create innovation that goes beyond LLMs and break out of the pre-training paradigm.
3/4: Some experts think this is doable for small models because they are cheaper to train.
Abstraction and hierarchy may be the next breakthroughs for RL.
The next real opportunities may be in the upstream of AI. Not just GPUs, but also memory and storage, special purpose chips, and even electricity supply. Semiconductor storage is another area worth watching.
Is there really an AI bubble right now?
I read an analysis today comparing the current AI boom with the tech boom in 2000. Based on valuations, earnings quality, and actual investment activity, it is still too early to call this a bubble.
2) Quantum computing for ML — as quantum computers mature, they may eventually power next-generation AI with unprecedented compute.
Plus, quantum technologies could help solve the massive energy consumption problem in today’s AI compute centers.
QPU (Quantum Processing Unit) is the core of quantum computers.
So how does QPU + AI come together?
1) AI for Science — for example, Google once used quantum AI to optimize error-correcting codes.
More👇
Gemini 3 changes everything. It’s not just an improvement; it's a step-function lead, dominating all benchmarks.
While everyone was betting on RL to break the LLM pre-training barrier, the G3 team credits better pre- and post-training. Maybe the scaling law is still the answer.
Our most anticipated launch of the year is here.
- Gemini 3, our most intelligent model
- Generative interfaces, for perfectly designed responses
- Gemini Agent, made to complete complex tasks on your behalf
See how Gemini 3 can help you learn, build & plan anything 🧵
@drfeifei@ylecun@Google 5/ 📐 Three directions, three philosophies
• Marble → “Make the world visible”
• Genie 3 → “Make the world explorable”
• JEPA → “Make the world understandable”
Recently, @drfeifei released Marble, a new world model. Here’s a quick look at how the current world-model landscape is shaping up.
Marble vs Genie 3 vs JEPA
Three very different paths toward AGI 🧵👇