We are hiring! I am looking to hire a PhD student to work on topics around AI evaluation from an HCI and technical standpoint. If you are interested, please apply through the Mila portal and put my name down as a potential advisor:
🎥 Ever wished to control what happens next during watching video? 🎬
You can decide the next scene, but keeping video coherent is hard. Meet VIS-Ground from @Google! We compile contextual dependencies for constrained long video generation.
🔊 Sounds on! Check more https://t.co/DpPY8kUqmu
@chenzhangreal@yuz9yuz Right! But we’re actually arguing that agents should ask clarifying questions only when necessary. Our study revealed that they tend to fill in missing information based on their learned priors, which could potentially be a useful signal that clarification is needed.
People tend to be more casual when asking AI questions than when asking another person. But what are the consequences? Can existing deep research agents (DRAs) infer what users leave unsaid through agentic reasoning and searching?
💡Introducing UNDERSPEC-DR, a framework for evaluating how deep research agents handle underspecified user queries.
📶Our results show that while DRAs can still generate answers grounded in cited evidence, their answers may fall short of satisfying users’ information needs substantially, even when one single detail is missing from the original query.
📄Paper: https://t.co/Xujx9WZaXO
(4/n) We hope our findings will inspire the development of DRAs that can dynamically decide when to ask users for clarification and when to continue searching during task execution, balancing reliable task completion with minimal user disruption.
Next week at #UIST2026 in Detroit, I'm presenting Doki, a text-native interface for generative video authoring (🏅Best Paper Honorable Mention)!
Here's the trailer…👇
So happy I could dance! 💃 Our paper "🪩 DiscoTrace: Representing and Comparing Answering Strategies of Humans and LLMs in Information-Seeking Question Answering" has been awarded Best Paper at #EMNLP2026!
https://t.co/FWpNrtVFPL
What are users thinking during their interactions with LLMs?
We introduce ThoughtTrace — the first large-scale dataset that captures what users think during real-world human–AI conversations, not just what they type.
→ 10,174 thought annotations
→ 2,155 multi-turn conversations, 17,058 turns
→ 1,058 users
→ 20 LLMs
These thoughts improve user behavior prediction (+41.7%) and model alignment (+25.6%).
This opens a new paradigm of user-centric LLM research. Full information in the thread 🧶
Read our paper: https://t.co/lRYJvGJ7bb
Check our project website: https://t.co/AupCn1YQOk
🤖 We often talk about “context rot”: LLMs get worse as context grows.
But once distracting information enters, is it just “a bit more noise → a bit worse performance”?
Our #ICML2026 paper finds: no! 🤯 Instead, we reveal a striking "First Drop of Ink" effect: the first very few hard distractors do almost all of the damage, exactly like how one drop of ink clouding clear water.
Paper link: https://t.co/s3zg49imUr
New Anthropic research: Natural Language Autoencoders.
Models like Claude talk in words but think in numbers. The numbers—called activations—encode Claude’s thoughts, but not in a language we can read.
Here, we train Claude to translate its activations into human-readable text.
While AI has the potential to automate semi-structured interviews, it falls short in perceiving nonverbal cues, building rapport, and strategically steering long-horizon conversations. At the same time, qualitative researchers often want to conduct interviews themselves, as doing so helps them better understand participants and may lead to deeper insights.
Instead of asking whether AI should replace interviewers, we asked: 𝗛𝗼𝘄 𝗰𝗮𝗻 𝗔𝗜 𝘀𝘂𝗽𝗽𝗼𝗿𝘁 𝗶𝗻𝘁𝗲𝗿𝘃𝗶𝗲𝘄𝗲𝗿𝘀 𝘄𝗶𝘁𝗵𝗼𝘂𝘁 𝗴𝗲𝘁𝘁𝗶𝗻𝗴 𝗶𝗻 𝘁𝗵𝗲 𝘄𝗮𝘆?
In our #CHI2026 paper, we introduce InterFlow, an unobtrusive form of AI assistance that supports interviewers in managing interview flow and facilitates real-time data sensemaking. InterFlow features ambient visualizations, mixed-initiative information capture, and process-oriented AI suggestions grounded in empirical knowledge of semi-structured interviewing.
Our user evaluation showed that InterFlow reduced cognitive load and helped interviewers keep track of both the big picture and important emerging details during interviews.
Huge thanks to my collaborators Yu Zhang, Sriram Suresh, and to my advisors @luzc08 , @canlhci , and @Iriskie_Xia!
Full paper: https://t.co/7fbCtMihIP
‼️Position: AI coding agent research needs recalibration.
We've heavily optimized for solo autonomy, and far less for designing agents that empower the humans using them.
It’s time to build human-centered coding agents. 🧵