🚀 Introducing Next-Concept Modeling (NCM): our new paradigm for fast, parallel, coarse-to-fine text generation.
Compared to strong diffusion language models (DLMs) at similar parameter size, NCM achieves:
⚡ Up to 31× faster generation on downstream tasks like summarization and machine translation with comparable or better quality.
🏎️ 10–21× faster unconditional generation across TinyStories, LM1B, and OpenWebText, with comparable or better generative perplexity and using 3–5× fewer training tokens.
🧩 Better performance on reasoning tasks like Sudoku, outperforming both AR and diffusion baselines with fewer sampling steps.
With @ishanskhare, @IddahMlauzi, @ekellbuch, @simran_s_arora, @Azaliamirh, and @HazyResearch.
More details in the thread 🧵👇
A 37-year-old man with a rare blood disease was being sent to hospice.
An AI model searched thousands of existing drugs and ranked a combination no one had tried for his condition.
He responded within a week. He is in remission.
The drugs were already on the shelf. The AI model found the match.
MUST SEE: Amazing moment as President Trump calls Nvidia CEO Jensen Huang while he's on stage at the All-In Summit.
@POTUS on AI Doomerism: “I'm telling you, it's all a hoax… and we're not going to let that happen.”
BYD rewrites the rules of EVs. At -30°C, its flash charging goes from 20% to 97% in 12 minutes, only 3 minutes slower than at room temperature.
And the network? China has already built over 10,000 such flash-charging stations across 332 cities.
Tomorrow will be my last day at Google after 27 years, and watching it grow from 25 people to 190,000+ has been an amazing journey. Below is a note I shared with many people internally at Google today. An excerpt is:
It has been an absolute pleasure to work with you and to help build some of the most widely used and impactful products of all time. As a kid, I dreamed of helping build software that would be used by many people, and Google now has thirteen products used by more than a billion people (amazing!). Our work has had a tremendous impact in the world, and I have been lucky enough to collaborate and form friendships with many colleagues that I deeply admire, respect, and enjoy. It still brings me joy every time I see people out in the world using our products to find information, handle email, translate documents, watch videos, learn new things, navigate and understand the physical world, browse the web, use their phone, run large-scale computations on our infrastructure, ride in an autonomous vehicle, or perform complex tasks with the help of our AI systems. I hope you all share this sense of joy, because it is a shared accomplishment! Thank you to all of my colleagues at Google over many years!
Now I'm excited to go start @DiscoLoopAI with my longtime friends and colleagues @Sanjay_Ghemawat, @OriolVinyalsML, and @quocleix.
(Updated post: slightly redacted to not have some personal info)
Officially a Doctor! 🎓🤖
Yesterday I defended my PhD on Scaling Trusted Autonomy: exploring how we can build generally capable robots whose decisions remain verifiable, interpretable, and worthy of our trust.
I’ll share more over the coming weeks.
For now … I’ll just be watching the sun rise on a slightly more grateful universe. 😄
The amount of rainfall recorded today is among the highest experienced in several years. Preliminary data indicates that approximately 140 millimetres of rain fell on Accra. By comparison, the highest single-day rainfall recorded last year was about 56 millimetres.
That aspect of the problem is beyond our control because it is driven by changing climatic conditions. There is the issue of human behaviour.
Whenever government begins removing structures built in waterways, some people accuse us of being inhumane. Yet when disasters such as today's flooding occur, the consequences affect everyone. The irresponsible actions of a few individuals end up putting entire communities at risk.