Does LLM really need to be a helpful assistant all the time?
No. If you want to simulate people, โperfectly helpfulโ could be the wrong objective.
Meet OdysSim, a journey toward LLMs beyond assistants, as behavioral foundation models (10B tokens of real human behavior; 23 sim benchmarks, finally in one place. new open models: outperform or on par with GPT-5.5, Gemini 3.1, or Claude Opus 4.7 in many behavior-sim dimensions).
Human behavior simulation is becoming essential.
Agent evaluation needs realistic users before real users show up. Medical and classroom training need realistic patients and students. Social science needs synthetic participants at scale.
But real people are not ideal assistants.
Real patients panic or ignore good advice. Real students misunderstand. Real customers are vague, picky, impatient, or simply leave. Human behavior is messy, diverse, and often imperfect.
Frontier LLMs are getting better at math, code, and long-horizon tasks. They are NOT getting better at simulating human behavior. If anything, they drift the other way: more assistant-ish, more homogeneous, fewer of the errors and quirks real humans show.
This is no accident. The whole pipeline is built for helpfulness and task success, not behavioral realism.
And you can't prompt your way out of that.
So we rethink the recipe from scratch and release:
๐ง The OdysSim corpus: 21.4M real human interactions (~10B tokens) from 62 sources, every conversation retrofitted with social grounding (who is talking, and why)
๐ SOUL-Index: 23 human-behavior benchmarks unified into one suite across 5 axes
๐ค OSim-8B: open weights; tops more SOUL-Index benchmarks than any frontier model, acts more like a real user than any of them on ฯ-bench (nearly matching real humans in the reaction dimension), and writes far more human-like text along the way.
Creating user simulators is a key to evaluating and training models for user-facing agentic applications. But are stronger LLMs better user simulators?
TL;DR: not really.
We ran the largest sim2real study for AI agents to date: 31 LLM simulators vs. 451 real humans across 165 tasks.
Here's what we found (co-lead with @sunweiwei12).
๐ Our paper has been accepted to #ICLR2026! ๐๐
This work was done during my internship at LG AI Research โ Superintelligence Lab. As summarized in the project:
Deep research requires broad evidence coverage and reliable synthesis.
HybridDeepSearcher achieves both by parallelย retrieval for breadth with sequential reasoning for depth, supporting scalable search.
๐ Project page: https://t.co/vKPfc0hAe1
๐ OpenReview: https://t.co/pWBlwdGjvL
Huge thanks to my mentors and co-workers for their guidance and support throughout this project. We also plan to release related work soon. Stay tuned! ๐
We are recruiting translators (any language/domain) for an interview study about translation technologies here!
Form: https://t.co/hBcZ1OLgiN
We will be grateful for all input!
1. Interviews will be on Zoom.
2. Participants will be given a $40 ๐๐บ๐ฎ๐๐ผ๐ป ๐๐ถ๐ณ๐ ๐ฐ๐ฎ๐ฟ๐ฑ!
๐ค๐ญWhat even is reasoning? It's time to answer the hard questions!
We built the first unified taxonomy of 28 cognitive elements underlying reasoning
SpoilerโLLMs commonly employ sequential reasoning, rarely self-awareness, and often fail to use correct reasoning structures๐ง
[10/10] ๐ Read the paper here: https://t.co/slPNepoPiZ
Looking forward, we hope this work motivates NLP and HCI communities to design explanation strategies and interaction paradigms that actively encourage critical engagement and uncertainty awareness. โฃ๏ธ
Hello colleagues and friends! โจPlease help repost and share โจ: I am officially on the job market for ๐๐ฒ๐ป๐๐ฟ๐ฒ ๐๐ฟ๐ฎ๐ฐ๐ธ ๐ฎ๐๐๐ถ๐๐๐ฎ๐ป๐ ๐ฝ๐ฟ๐ผ๐ณ๐ฒ๐๐๐ผ๐ฟ and ๐ถ๐ป๐ฑ๐๐๐๐ฟ๐ ๐ฟ๐ฒ๐๐ฒ๐ฎ๐ฟ๐ฐ๐ต ๐ฟ๐ผ๐น๐ฒ๐ where I can apply my research to real-world AI safety challenges!!
My work combines empirical studies and system building to explore topics such as ๐ฟ๐ฒ๐๐ฝ๐ผ๐ป๐๐ถ๐ฏ๐น๐ฒ ๐๐ (๐ฅ๐๐), ๐๐ ๐๐ฎ๐ณ๐ฒ๐๐, ๐ฎ๐ป๐ฑ ๐ต๐๐บ๐ฎ๐ป-๐๐ ๐ฐ๐ผ๐น๐น๐ฎ๐ฏ๐ผ๐ฟ๐ฎ๐๐ถ๐ผ๐ป. To this end, I develop tools and processes to support responsible AI in real world industry settings, particularly in the contexts of ๐๐ ๐ฎ๐๐ฑ๐ถ๐๐ถ๐ป๐ด, ๐ฟ๐ฒ๐ฑ-๐๐ฒ๐ฎ๐บ๐ถ๐ป๐ด, ๐ฎ๐ป๐ฑ ๐ถ๐บ๐ฝ๐ฎ๐ฐ๐ ๐ฎ๐๐๐ฒ๐๐๐บ๐ฒ๐ป๐.
I am beyond trilled to present two ๐ award-winning papers โจ @ACM_CSCW in beautiful Bergen, Norway!! Broadly, I'm excited to chat about responsible AI, AI auditing and red-teaming, and human-agent interaction. Say hi if we run into each other!
๐๐๐๐ฎ๐๐ข๐ญ: ๐๐๐๐๐๐จ๐ฅ๐๐ข๐ง๐ ๐๐ฌ๐๐ซ ๐๐ฎ๐๐ข๐ญ๐จ๐ซ๐ฌ ๐๐ง๐ ๐๐ ๐๐ซ๐๐๐ญ๐ข๐ญ๐ข๐จ๐ง๐๐ซ๐ฌ ๐ข๐ง ๐๐ฎ๐๐ข๐ญ๐ข๐ง๐ ๐๐๐ง๐๐ซ๐๐ญ๐ข๐ฏ๐ ๐๐
๐ Best Paper Awards (Top 1% Submissions)
๐ https://t.co/5HvRbMgGWk
๐ Mon, 20 Oct | PM, CET: Online & AI Harms
๐๐จ๐๐ข๐๐ญ๐๐ฅ ๐๐ฆ๐ฉ๐๐๐ญ ๐๐ฌ๐ฌ๐๐ฌ๐ฌ๐ฆ๐๐ง๐ญ ๐๐จ๐ซ ๐๐ง๐๐ฎ๐ฌ๐ญ๐ซ๐ฒ ๐๐จ๐ฆ๐ฉ๐ฎ๐ญ๐ข๐ง๐ ๐๐๐ฌ๐๐๐ซ๐๐ก๐๐ซ๐ฌ
๐ Best Paper Honorable Mention (Top 3% Submissions)
๐ https://t.co/1ZfuvuqwBu
๐ Wed, 22 Oct | AM, CET: Toward More Ethical and Transparent Systems and Environments
#CSCW2025 #AISafety #ResponsibleAI
Iโm โจ super excited and grateful โจto announce that I'm part of the 2025 class of #PackardFellows (https://t.co/MUl0kGlC3h). The Packard Foundation and this fellowship will allow me to explore exciting research directions towards culturally responsible and safe AI ๐๐