(1/3) My favorite figure from the paper.
Nearly all open-source RL frameworks introduce an unintentional bias when computing the masked mean 😮. The fix? Just replace mask.sum with a constant.
AI is moving from on-demand to always-on. But can it learn when you actually want help?
We introduce Deep Personalization: an Observer Agent that continually learns from your work patterns and implicit feedback to decide when to step in.
It improves proactive-timing F1 by 2.4–3.0× across three model backbones.
We co-design the agent and its training and inference engines to run the Observer locally on systems like NVIDIA DGX Spark, keeping your screen observations on-device.
The next PC won’t wait for your prompt. It will learn when to help! Check out our blog at: https://t.co/5L45HkXtFM
Thank you @LaudeInstitute for the generous support!
So excited to work with @tatsu_hashimoto, @chrispiech, @erikbryn and our team to build collaborative AI that complements human expertise and helps people develop new skills as work evolves!
Understanding AI’s impact on work starts with knowing what workers actually do.
Excited to share TaskNet 🥳 We use AI interviews to map tasks across 6 occupations, uncovering emerging tasks and overlooked work.
Amazing work by @jennjwang and the team!!!
Understanding how AI is reshaping work starts with understanding what people actually do!
TaskNet offers a snapshot of work today, and more importantly, it provides a scalable way to track how work evolves over time 🤩
Check out the amazing work led by @jennjwang !
https://t.co/xG4czm6j5N
Jobs are modeled as bundles of tasks. But as jobs change, how do we keep those task lists up to date?
Workers often experience new responsibilities and tools before they reach their job descriptions.
We start by listening to them. 🧵
@GenReasoning very cool work! i wonder if the training also improves the team performance on tasks where coordination is necessary, e.g. cooperbench
i guess ceo + two workers is a fair setting.
AI is getting remarkably good at doing things for humans. We know much less about how to make it better at helping humans learn.
We study learning to teach adaptively: how AI can adapt its teaching to each learner’s evolving understanding, and how this capability can itself be optimized through reinforcement learning.
A small step toward AI that doesn’t just solve problems, but helps people understand and grow.
More details in @WeixianXu ’s thread 👇
Language models already excel at math, but human growth remains essential: we need AI to teach people, not replace them!
Teaching is different from solving. As the Chinese principle “因材施教” suggests, preferences differ from person to person, and a good teacher should adapt their teaching to each learner.
We introduce Sherpa, a framework for training LLMs to teach adaptively.
I'm on the academic job market this year!
Recently I've been working on scaling laws and human-centered interventions for building more socially grounded AI.
If you're attending #COLM2026, please drop me a DM or email. I'd love to chat!
I'm on the job market this year!
I work on measuring the societal impacts (overreliance, homogenization etc.) of AI/LLMs and proposing ways to mitigate these.
I'm at #COLM this week, and #NeurIPS later this year, and would love to chat more!
As agents increasingly interact with each other, alignment becomes a property of the system, not just of individual agents.
In our new work (@xinruishi11, @Diyi_Yang), we stress-test whether collusion can emerge through repeated interaction.
Even when no agent is told to misbehave, we find that agents adapt to one another and can end up jointly violating their instructions.
People have realized the influence of AI companionship on our mental well-being. But how this happens remains a mystery.
In our new preprint, we followed users for about one year. Our data reveal that greater social engagement with AI companions consistently predicts lower well-being, which is driven in part by lower real-world social interaction with other people.
How does one RL post-train a 397B model for long-horizon knowledge work? 👩💼
We share every step we took to bring Qwen 3.5 397B from 16.1% Pass@1 to 27.3% on APEX-Agents using DPPO, including final models weights and the full training script🚀 This is the first of many works from Mercor Research on open model training research.
Full blog: https://t.co/GWgR2DB7iy
Source code: https://t.co/96h8ADfvBp
With Prof. @EmmaBrunskill , we're looking for a postdoc with expertise in LLMs and RL to work on building AI systems for long-term well-being! Please apply by 09/15: https://t.co/qRKv98uglg
"If you look at … where the economic value concentrates, the software engineer only captures around less than 5% of human employment, but there are a lot of other occupations out there that are using computers."
For EP6, we welcome @ZhiruoW, a CS PhD student at Carnegie Mellon studying how AI agents and humans work, and how they can better work together. In this episode, Zora explains why the "automation vs. collaboration" debate is a false dichotomy and argues that by deeply understanding human workflows, we can build agents that actually empower us to do more!
0:00 - Introduction
4:57 - Agent Workflow Memory
9:26 - From Program Synthesis to Agent Research
11:16 - Tools, Actions, and Skills
18:47 - Human Work vs. Agent Work
21:19 - Autonomous Agents vs. Collaborative Agents
29:47 - Picking Research Problems in the Age of AI Agents
34:09 - The Role of Coding Ability in Agent Development
36:49 - Cutting Through the Fear Mongering: Building Agents Responsibly
45:02 - What’s Next? (The Future of Human-Agent Collaboration)
52:42 - Final Takeaway