๐ฅโจ Consistent Videos from Agent Generated 3D Prior
Check out our short demo film, crafted with our work on agent-based pipeline for generating controllable and physically plausible videos. (Unmute for the narration!) ๐ Project link: https://t.co/6PsmcpFM5s
#AIGC ๐๐ฅ
Here are a few test cases I ran with @LumaLabsAI 's new Dream Machine. The consistency, camera motions are amazing. 1. Prompt: spiderman, running on a rooftop and jumping off, city night. Shows large camera motion that was not possible with previous openly available models.
Testing Luma AI on complicated physical interactions. Test 1: a group of dogs run towards the camera, running into each other and scatter, and run into each other, and scatter, repeatedly.
Prompt: a man opens a car's door, enters the car, and sits in the driver's seat. Analysis: model (or maybe prompt enhancement) has learned to split the scenes, avoiding the complicated physical actions of door opening, entering the car.