MAGMaR

on Multimodal Augmented Generation via MultimodAl Retrieval

[MAGMaR @MAGMaR_workshop]

No system in this track uses task-specific fine-tuning, and every system converts videos to text before reasoning. Multi-video reasoning has lots of room for improvement.

[MAGMaR @MAGMaR_workshop]

🧵 The MAGMaR 2026 Shared Task results are out!

We challenged teams to retrieve relevant videos from a corpus of 110K+ multilingual clips AND generate grounded, persona-driven articles from them.

Come see the findings at our workshop at ACL on July 4!

https://t.co/9YNvHbEYKH

[MAGMaR @MAGMaR_workshop]

🤔What we learned abt generation:
Humans and automatic metrics don't agree on what's good here. Annotators rewarded systems that said "I don't have enough evidence to answer that" MiRAGE penalized them for it. Figuring out how to evaluate appropriate refusal is a clear next step

[MAGMaR @MAGMaR_workshop]

Nanyun (Violet) Peng @VioletNPeng is giving a Keynote entitled "Towards Self-Improving Multimodal Models"

Chenliang Xu's keynote will be "Multi-level Alignment in Audio-Visual Scene Generation and Learning" @ChenliangXu

[MAGMaR @MAGMaR_workshop]

Just over a week and a half until the MAGMaR 2026 Workshop at @aclmeeting We look forward to seeing you in San Diego! https://t.co/I4cEEoWQAC

[MAGMaR @MAGMaR_workshop]

⏰ Deadline extended! The submission deadline for MAGMaR 2026 is now April 15. Don’t miss your chance to share work on multimodal retrieval & generation at ACL 2026! 🚀
👉 https://t.co/I4cEEoWQAC

Shared Tasks (Retrieval, Generation, & RAG) are April 20th! See you in San Diego!

[MAGMaR @MAGMaR_workshop]

This year's shared task allows you to submit for the retrieval track, generation track, or full RAG track on a challenging new collection of unedited ("raw") videos.

Research Papers (Apr. 1)
Shared Task (Apr. 20)

[MAGMaR @MAGMaR_workshop]

📹 + 🧠 + 📝 = 🔥 First call for MAGMaR 2026, the 2nd workshop on multimodal augmented generation via multimodal retrieval! If #RAG isn't hard enough for you, try multilingually and multimodally. Collocated with @aclmeeting in San Diego in July.

https://t.co/I4cEEoWQAC

[MAGMaR @MAGMaR_workshop]

UPDATE: Shared task paper deadline is **5/20**, not 5/9!

[MAGMaR @MAGMaR_workshop]

24 hours left to submit a paper to the Multimodal RAG workshop at #acl2025! We welcome all papers on related topics. Also be sure to check out our shared task (paper deadline 5/9).

https://t.co/WhjOkkSi4A

[MAGMaR @MAGMaR_workshop]

https://t.co/Mext8ybvWM

[MAGMaR @MAGMaR_workshop]

🚨 IT'S HERE! 🚨
The Eval Leaderboard is now LIVE! 🏆💻

Our video retrieval collection stumps most pre-trained models. See if you can build a better system!

https://t.co/adA7rWffaL

[MAGMaR @MAGMaR_workshop]

🚨 IT'S HERE! 🚨
The Eval Leaderboard is now LIVE! 🏆💻

Our video retrieval collection stumps most pre-trained models. See if you can build a better system!

https://t.co/adA7rWffaL

[MAGMaR @MAGMaR_workshop]

Submit here: https://t.co/WhjOkkSi4A

[MAGMaR @MAGMaR_workshop]

🚨 Deadline extension! 🚨

The MAGMaR paper submission date has been extended to May 1, 2025 (archival and non-archival). Show off your multimodal + RAG projects!