Thanksgiving-week treat: an epic conversation on Frontier AI with @lukaszkaiser -co-author of “Attention Is All You Need” (Transformers) and leading research scientist at @OpenAI working on GPT-5.1-era reasoning models.
00:00 – Cold open and intro
01:29 – “AI slowdown” vs a wild week of new frontier models
08:03 – Low-hanging fruit, infra, RL training and better data
11:39 – What is a reasoning model, in plain language
17:02 – Chain-of-thought and training the thinking process with RL
21:39 – Łukasz’s path: from logic and France to Google and Kurzweil
24:20 – Inside the Transformer story and what “attention” really means
28:42 – From Google Brain to OpenAI: culture, scale and GPUs
32:49 – What’s next for pre-training, GPUs and distillation
37:29 – Can we still understand these models? Circuits, sparsity and black boxes
39:42 – GPT-4 → GPT-5 → GPT-5.1: what actually changed
42:40 – Post-training, safety and teaching GPT-5.1 different tones
46:16 – How long should GPT-5.1 think? Reasoning tokens and jagged abilities
47:43 – The five-year-old’s dot puzzle that still breaks frontier models
52:22 – Generalization, child-like learning and whether reasoning is enough
53:48 – Beyond Transformers: ARC, LeCun’s ideas and multimodal bottlenecks
56:10 – GPT-5.1 Codex Max, long-running agents and compaction
1:00:06 – Will foundation models eat most apps? The translation analogy and trust
1:02:34 – What still needs to be solved, and where AI might go next
I’m 13. Last month I spent a week in San Francisco for Founders Inc’s off-season.
In 7 days I:
was the youngest at demo day
visited a16z & Cluely HQ
met founders I’d only seen online
went viral cold-emailing 75 OpenAI engineers and ended up in Sam Altman’s office.
Here’s the full story.
People have asked about our culture and recent employee communications. Cognition has an extreme performance culture, and we’re upfront about this in hiring so there are no surprises later. We routinely are at the office through the weekend and do some of our best work late into the night. Many of us literally live where we work. We know that people who joined Windsurf didn’t expect to join Cognition and while we’re proud of how we work, we understand it’s not for everyone.
We gave our team the opportunity to decide. We offered for all employees who joined via acquisition to opt into our culture with full clarity on what entails. We know that we will lose some strong talent in doing this, but we truly believe the level of intensity this moment demands from us is unprecedented. While not everyone is looking for a culture like ours, everyone deserves respect and appreciation for their work. Regardless of their decision, we accelerated and cashed out all four years of equity for everyone from Windsurf, even for the 85% of employees who hadn’t hit their one year cliff. And for those who opt out, we’re providing an additional nine months of pay on top of this.