MBZUAI @mbzuai celebrated it's 5th anniversary, and I had the opportunity to present CVQA (NeurIPS Oral) , selected as one of MBZUAI’s most impactful research projects. Recently, I also presented my latest work on video generation "KineMask", winning a second best poster award !
Introducing our new frontier video model, Runway Gen-4.5. Previously known as Whisper Thunder (aka) David.
Gen-4.5 is state-of-the-art and sets a new standard for video generation motion quality, prompt adherence and visual fidelity.
Learn more below.
🚀 Introducing KineMask 🎭 , an approach for physics-guided video generation that enables realistic rigid body control and interactions. Given a Single Image and an Object Velocity ❗, KineMask generates videos with inferred motions and future object interactions !!!
Check out more results and our full paper: "Learning to Generate Object Interactions with Physics-Guided Video Diffusion"
🌐https://t.co/cDxNlHuS1M
📜https://t.co/cP2gkZxmpn
Work Done with: Ariana Bermudez, @HaoLi81, Fabio Pizzati and Ivan Laptev !
🚀 Introducing KineMask 🎭 , an approach for physics-guided video generation that enables realistic rigid body control and interactions. Given a Single Image and an Object Velocity ❗, KineMask generates videos with inferred motions and future object interactions !!!