Ever wondered whether AI agents could play thousands of video games on a supercomputer? We did. ๐ฎ
Introducing PlaySuite: 5,734 games, 14 open models, and a large-scale benchmark for interactive visual intelligence.
Here's what we built, and what we learned. ๐งต๐
A huge shoutout to the wonderful team behind PlaySuite! ๐ฎ
It was a pleasure working with @AVettoruzzo, @iWSimoncini, Michelle Acevedo Callejas, @mmderakhshani, Kristof Meding, @joavanschoren, and @cgmsnoek.
Thanks for making this possible! ๐
Nearly a decade after @OpenAI Universe, PlaySuite revisits the vision of evaluating general-purpose agents across thousands of interactive worlds.
Can your agent play games it's never seen before? ๐ฎ
๐ https://t.co/4hZfyWsB96
โพ๏ธ LiFT: Loop Flow Transformers ๐งต๐
Diffusion models usually spend more inference compute by taking more sampling steps. What if we could also spend compute inside each step?
LiFT turns part of a DiT into a recurrent core, letting us scale depth at inference with only a small architectural change. On ImageNet, it beats dense DiT-XL/2 with 3.34 lower FID, while using 60% fewer parameters, 32% fewer training FLOPs, and 52% fewer inference FLOPs.
Jointly led with Mohammad Mahdi Derakhshani ๐(@mmderakhshani)
And amazing supervisors Cees Snoek (@cgmsnoek), Jan-Willem van de Meent (@jwvdm) and Gertjan J. Burghouts (@gjburghouts)
3 days. Worldwide. Inspiring & starting new research collaborations. Introducing the Connect conference. ๐๏ธ
Join for incredible speakers, including @1vnzh@jpineau1@mziizm & @ShayneRedford + >20 researchers discussing how collaboration and open science are driving progress. ๐
Through NeoBabel, Iโve experienced how large-scale distributed training works in practice. @mmderakhshani's walkthrough distills those lessons, illustrating the five key parallelism strategies. A great read๐
Does vision training change how language is represented and used in meaningful ways?๐ค The answer is a nuanced yes! Comparing VLM-LM minimal pairs, we find that while the taxonomic organization of the lexicon is similar, VLMs are better at _deploying_ this knowledge. [1/9]
๐ผ๏ธ What does it take to build a multilingual image generation model that is both efficient and competitive?
๐ In collaboration with @UvA_Amsterdam, we introduce NeoBabel, a 2B multilingual text-to-image model trained natively in 6 languages.
T1/11
Text-to-image AI is amazing, but what if you don't speak English? Most are English-centric, creating barriers for billions.
We introduce NeoBabel, a new open model for visual generation that natively understands 6 languages, breaking down the walls of digital inequity. ๐๐ฃ๏ธ