I found my old insta360, put it on the bike and ran a quick test.
In this experiment I'm trying different controlnets with LTX-2 in ComfyUI to see what I’ll get.
First tests are promising, but trees turning into dust clouds and a third rear wheel is not what i need haha.
I’ll probably have to mask the rear wheel and trees before processing. I think it would give me a cleaner result. The main quest is still to explore ways to keep control of the shot, perspective and spatial depth. Controlnets can definitely help with that. Using Real footage is fun and gives free motion details, but I think a simple 3D animation would be faster.
btw I got my first frame in 5x4 aspect ratio. Changed it to 16x9 with Qwen in ComfyUI by adding black bars on the sides and prompted to remove the black bars. Worked surprisingly well.
Running all tests locally on a 3090