finally sharing what i've been up to! left phd end of 2025 and co-founded Engram.
there are a few startups in SF right making very different bets on the right way to train AI models. this is ours:
people want models that learn over time, remember details, adapt and interact like a person would
everyone gets a model. your model updates ~every minute. this is the world we're building. :)
New piece in @TheAtlantic!
We always hear that AI will cure cancer, and I would immediately benefit if it did. But I argue that racing ahead on generalist AI models creates unclear benefits for cancer that are outweighed by broader societal harms.
(Gift link in next post)
Introducing ><former
Most transformers are rectangles◻️: every layer has the same width
But is that optimal?🤔
We propose variable-width transformers that have different widths across layers, improving loss while cutting compute & KV cache size 🧵
I'm joining OpenAI next week!🥹 The job search turned out to be really challenging but also super rewarding, so I wrote a small blog to share what I learned along the way and hopefully make the process a little less mysterious for the next person. https://t.co/6FigSBdenD
Base models generate more diverse responses than their post-trained counterparts but are also much worse at instruction following. We recover diversity with a simple recipe: the instruct model rewrites messy base generations into high-quality responses, and we then run DPO with this synthetic data. The resulting model is more diverse without sacrificing instruction following! Details 👇
Hooded six PhD students yesterday, my very first cohort at Princeton: Zexuan Zhong (@ZexuanZhong, 2024), Dan Friedman (@danfriedman0, 2025), Howard Chen (@__howardchen, 2025), Mengzhou Xia (@xiamengzhou, 2025), Tianyu Gao (@gaotianyu1350, 2025), and Alex Wettig (@_awettig, 2026)!
They started their PhD at the beginning of the pandemic and lived through one of the most revolutionary stretches our field has ever seen. Their work has shaped how we think about language models today. So proud of them, and can't wait to see what they do next!
AI is changing how employers hire workers.
Today we are publishing our research over the past four years into this high-stakes application of AI.
We independently studied the impacts of deployed AI hiring tools based on the real outcomes for 3.3 million people.
For decades, we’ve trained AI to chase rewards. But humans don’t just optimize outcomes. We experience, reflect, then learn.
Can AI do the same?
Introducing 𝐄𝐱𝐩𝐞𝐫𝐢𝐞𝐧𝐭𝐢𝐚𝐥 𝐑𝐞𝐢𝐧𝐟𝐨𝐫𝐜𝐞𝐦𝐞𝐧𝐭 𝐋𝐞𝐚𝐫𝐧𝐢𝐧𝐠, a step toward AI that truly learn from experience.
Super duper excited to announce that I'll be at @togethercompute this summer starting on May 18th, working on 🎓 Agents for Education 🎓!!! Please hmu if you're in SF and we can party 🎉🎉🎉🥂🥂🥂
Another call for submissions to the Human-AI Co-Creativity Workshop @ ICML 2026!
The deadline has been extended to 💚💚May 8💚💚, and we warmly welcome submissions of papers that are also being submitted to other conferences, such as NeurIPS. We would love to see your work at the workshop!
I’ve never been this excited about search.
6-7 years ago, IR got an influx of the paradigms we still use, all enabled by the big headroom MS MARCO and then BEIR created. Then progress slowed.
Today, Diane releases perhaps the most ambitious IR benchmark to date: OBLIQ-Bench.
Queries in it are meant to be increasingly opaque to current first-stage retrieval paradigms. Oblique queries put the bottleneck very early in the search process, as the relevance of a document to the query is quite latent.
I can't wait for core IR research on fundamentally more powerful paradigms for first-stage search to be reignited again. Stay tuned for more stories about this, and read Diane's thread and her paper below!!
Extremely excited about our work on Compute Optimal Tokenization! This paper categorically nails down the role that compression plays in compute optimality and recommends how to scale models keeping compression in mind. Cool results on multiple languages too!
We just released KARL — a knowledge agent trained with reinforcement learning that beats Claude Opus 4.6 and GPT-5.2 on enterprise search, at a fraction of the cost and latency.
🧵
Come join us! 2-year Postdoc opportunity at CMU's AI-Human Research Center on how LLMs can train workers in social skills across different envs. You'll work with Haiyi Zhu, Bob Kraut, Yi-Chia Wang, myself at CMU, and Diyi Yang at Stanford.
Apply here! https://t.co/AqJi3Jg6Vr
Internship opportunity! Please share!
📣 I'm looking to hire an intern in human-centered NLP for the agents team @togethercompute. Come work on frontier AI systems that tackle complex agentic tasks!
Research direction is open and looking to publish in NLP and HCI venues
We just shipped a test release of EN → ZH real-time speech-to-speech translation.
Built with our SOTA S2S model koto-v1 🧠⚡
Try it free on the "Kotoba" app — now live on iOS & Android.
Language barriers are disappearing. 🌏🔥
📱iOS | 🤖 Android: https://t.co/Faa3EnPmq1
#AI #SpeechAI #Translation #Kotoba
I'm hiring interns for next summer at @databricks! Specifically on (1) empirical RL at scale on non-verifiable tasks and (2) enabling real people specify the behaviors they want out of AI (e.g., through evals) on highly complex tasks. 🧵