Huge thanks to my amazing collaborators Seungryong Kim at @KAIST_AI and Dongyoon Han and Sangdoo Yun at @NAVER_AI_Lab
๐ฅ Project page: https://t.co/pFHjOVaW1n
๐ Paper: https://t.co/Fp2qdchz8b
Does every token need to be denoised until the final step? ๐ค
No! We introduce โกSpeculative Forcingโก, which accepts tokens as soon as they converge and keeps denoising only the rest
Project page: https://t.co/pFHjOVaW1n ๐งต (1/n)
World models
It works the same way. As the camera moves, regions the model has already seen converge quickly, so only the newly revealed parts need more steps. 2.55 steps per token on average, 1.35ร faster, with camera accuracy on par with 4-step.
5/n
Long video generation
It holds up over 30 seconds. 1.72 steps per token on average, 1.54ร faster, and drift over the rollout is lower than the 4-step baseline, not higher.
4/n
Short video generation
Most tokens converge within one or two steps, and the remaining steps go where they are still needed. 1.68 steps per token on average instead of 4, 1.58ร faster.
3/n
How it works. Each intermediate estimate is a draft. A verifier predicts how far a tokenโs draft is from the full-step output. Within tolerance, the token is accepted and committed. Only the rejected tokens enter the next pass.
2/n
TLDR; How can a world model continuously observe regions beyond the actorโs current view? Placing panoramic observers where we want, it evolves and controls the actorโs unseen regions.
World models have one eye: the camera.
They can evolve what they see, but the rest of the world quickly goes unobserved.
So what if we gave them more eyes, like LoL wards or StarCraft Observers, and let them move around the world?
We introduce World Observer!
TL;DR: Keep the off-screen world evolving. Joint actor-observer generation with freely placed and movable panoramic observers.
Proj page: https://t.co/mDFlz5gvKb
@KAIST_AI@hyunwookee
World models have one eye: the camera.
They can evolve what they see, but the rest of the world quickly goes unobserved.
So what if we gave them more eyes, like LoL wards or StarCraft Observers, and let them move around the world?
We introduce World Observer!
TL;DR: Keep the off-screen world evolving. Joint actor-observer generation with freely placed and movable panoramic observers.
Proj page: https://t.co/mDFlz5gvKb
@KAIST_AI@hyunwookee
๐๐๐จ๐ฎ๐ฅ ๐๐จ๐ซ๐ฅ๐ ๐๐จ๐๐๐ฅ has been selected as a ๐๐ฉ๐จ๐ญ๐ฅ๐ข๐ ๐ก๐ญ ๐๐ซ๐๐ฅ ๐๐ซ๐๐ฌ๐๐ง๐ญ๐๐ญ๐ข๐จ๐ง at #ECCV2026 ๐ฅ
Feel free to drop by Room Palissad on Friday morning. Iโd love to chat, especially about World Models! Feel free to DM me :)
What if a world model could render not an imagined place, but the actual city?
We introduce Seoul World Model, the first world simulation model grounded in a real-world metropolis.
TL;DR: We made a world model RAG over millions of street-views.
proj: https://t.co/Bx4KUAqrRs