amrita

@nvidia research

[Tianye Li @_TianyeLi]

Xueyan Zou @xyz2maureen's talk on "Actionable World Representation" happens now at 4DDT 2026 workshop #CVPR2026

[Tianye Li @_TianyeLi]

@CVPR @KaterinaFragiad @jhugestar @GordonWetzstein @frncswllms @xyz2maureen @amritamaz @GordonWetzstein's talk on "From World Models to World Agents" starts now at 4DDT 2026 workshop #CVPR2026

[Tianye Li @_TianyeLi]

@jhugestar @frncswllms is presenting "fVDB: A Framework for Sparse, Large-Scale and High-Performance Spatial Intelligence" at 4DDT 2026 workshop #CVPR2026

[Tianye Li @_TianyeLi]

@jhugestar is sharing his insights on "Teaching Robots Our Everyday Labor: From 3D Data and 2D Video to Self-Learning" at 4DDT 2026 workshop #CVPR2026

[Tianye Li @_TianyeLi]

@CVPR @KaterinaFragiad @jhugestar @GordonWetzstein @frncswllms @xyz2maureen @amritamaz @KaterinaFragiad is giving the keynote talk on "Learning Persistent 4D World Models from Video" at 4DDT 2026 workshop #CVPR2026

[Tianye Li @_TianyeLi]

@CVPR @KaterinaFragiad @jhugestar @GordonWetzstein @frncswllms @xyz2maureen Amrita @amritamaz is giving the opening remark at 4DDT 2026 workshop #CVPR2026

[Xueyan Zou @xyz2maureen]

Really appreciate the opportunity to share our new direction on 4D Digital Twins 🌍✨
Actionable World Representation is a research direction initiated during my postdoc, and I’m excited to develop it as a new stream of work in my lab.
I’ll be presenting this work virtually in CVPR2026 today from 4:30–5:15 PM in Room 2C. Looking forward to sharing and discussing! 🚀
#CVPR2026

[amrita @amritamaz]

very excited for the 4D Digital Twins workshop happening tomorrow #CVPR2026 ! we have an amazing set of speakers talking about 4D real-to-sim-to-real challenges🦾
🗓️ Thurs June 4 · 1:00 – 6:00 PM
📍 Mile High 2C
🔗 https://t.co/ixYX8TTkBt

[amrita @amritamaz]

happening tomorrow! see you all there!

[Koki Nagano @luminohope]

🤖 At #CVPR2026 next week? Join the 1st Interactive Physical AI Workshop (IPA 2026) — embodied social agents, full-duplex multimodal conversation & lifelike robots and avatars and more!

🗓️ Wed June 3 · 8:25 AM–1:00 PM MDT
📍 Rooms 210/212

Keynotes:
• Alexander Richard (Meta) — Embodied Social Agents in XR
• Maja Matarić (USC / Google DeepMind) — Human-Centered AI & Robotics
• Agon Serifi (Disney Research) — From Human Motion to Robot Behavior

🔗 https://t.co/47gIzm6ZHK
@NVIDIAAI @swookpark @shalinidemello @mct1224 @amritamaz @lmathur_

[amrita @amritamaz]

@_Suresh2 we feed in the input as a continuous stream, and full-duplex models produce a continuous output stream for the agent, so we can then evaluate them jointly (word-level transcripts, timing, etc)

[amrita @amritamaz]

Excited to release VideoFDB: the first benchmark for full-duplex audio-visual-to-audio-visual (AV2AV) conversational agents. VideoFDB tests whether models can act as active interlocutors in 1:1 conversation, not just answer questions about video.

[amrita @amritamaz]

finally, this was a great joint work with @swookpark @rjrshr @mct1224 @luminohope @shalinidemello and others, and a huge thanks to @withdavidai for helping us collect the dataset!

[amrita @amritamaz]

If you have an interaction model you'd like to evaluate with VideoFDB, check out the data on HuggingFace and reach out with your results!
🏆 [Project page + leaderboard]: https://t.co/PUDaLMPyrG
📄 [arXiv]: https://t.co/EFvkX247l5
🤗 [HuggingFace]: https://t.co/jAiES5KbuA

[Koki Nagano @luminohope]

🤖 At #CVPR2026 next week? Join the 1st Interactive Physical AI Workshop (IPA 2026) — embodied social agents, full-duplex multimodal conversation & lifelike robots and avatars and more!

🗓️ Wed June 3 · 8:25 AM–1:00 PM MDT
📍 Rooms 210/212

Keynotes:
• Alexander Richard (Meta) — Embodied Social Agents in XR
• Maja Matarić (USC / Google DeepMind) — Human-Centered AI & Robotics
• Agon Serifi (Disney Research) — From Human Motion to Robot Behavior

🔗 https://t.co/47gIzm6ZHK
@NVIDIAAI @swookpark @shalinidemello @mct1224 @amritamaz @lmathur_

[amrita @amritamaz]

See you all there!!

📍CVPR 2026, Denver
📅 Thursday, June 4, 2026 | 1:00–6:00 PM
🔗 Workshop page: https://t.co/W63zhUqutl

[amrita @amritamaz]

📢 Really excited to announce the first ever 4D Digital Twins: Real-to-Sim-to-Real for Physical AI (4DDT) workshop at CVPR 2026!

As physical AI continues to gain momentum, we see 4D digital twins as an increasingly important direction for the research community. 🧵

[amrita @amritamaz]

The first edition of 4DDT brings together a world-class group of experts: @KaterinaFragiad , @jhugestar , @xiaolonw , @GordonWetzstein, and @frncswllms , who will share their insights across robotics, vision, and graphics.