OSCaR is now public: project page, code, dataset, and checkpoints.
NAACL work on object state captioning and state-change representation for grounded video understanding.
Project: https://t.co/eX2UmHvBzV
Paper: https://t.co/HHOeY6T0JI
Dataset: https://t.co/th71UD9CHe
Our benchmark VERIFY was accepted at COLM 2026.
600 puzzles, each with a human-annotated reasoning path: we grade how models reason, not just what they answer.
Try this one. In our evaluation, most frontier models missed it.
Something we did over the summer. One thing I’m particularly proud about this work is how easy the task could’ve been (literally just caption the images!), and how many extra steps we took just to make sure creators can actually use this system in their work, rather than just making it as a research POC. You’ll see in the paper how many ablations and extra design we did, as well as some choices we deliberately made despite objective metrics telling us otherwise.
The additional steps weren’t required to make it a valid paper, but are crucial to making it something people actually will be willing to use. Thanks so much for @ali_vosough and the team for working together on this!
🚀 HUGE thanks for the mentorship of @yongyi_zang and Randal Leistikow for the opportunity, and great teamwork @rocksoul183 and Nathan Paek and my advisor @ChenliangXu ✨
🚀 Released AVE-2: A dataset for unified audio-video understanding + generation
Designed for training models that both perceive and synthesize across modalities.
Perfect for testing your next multimodal architecture.
🔗 https://t.co/DXEIYVLp38
#MultimodalAI#AudioVisual
@ysbhalgat@CVPR Great to see activities for CVPR @ysbhalgat ! I'm also presenting our vision agents work and looking to connect with teams working on multimodal AI, especially audio-visual intelligence. Looking forward to productive discussions in Nashville! 🎯
Exploring new platforms as @X evolves! Join me on @bluesky to reconnect and build a vibrant community. Excited for this fresh start!
Find me on Bluesky: https://t.co/wxWmXD80wl