Introducing Runway Aleph, a new way to edit, transform and generate video.
Aleph is a state-of-the-art in-context video model, setting a new frontier for multi-task visual generation, with the ability to perform a wide range of edits on an input video such as adding, removing and transforming objects, getting new angles of a scene and modifying style and lighting, among many other tasks.
🚨 Runway Livestream — Today at 1PM ET! 🚨
Join @IXITimmyIXI on @runwayml’s Discord for a special Gen:48 prep stream with community legend Javier De La Chica for tips, strategies, and maybe a few Aleph secrets to help you crush the next challenge.
Gen:48 returns this August 23rd to 25th for a special Aleph Edition. Mark your calendar for another 48-hours of filmmaking.
Register today at the link below.
New Aleph features and mobile updates, Gen-4 Image Turbo comes to the API and another community showcase. Get caught up on what happened This Week with Runway.
Introducing AI for VFX by @iamneubert and @notiansans: https://t.co/PUCbY6DLRr
A 6-part series on integrating Runway into your vfx pipeline. Learn how to:
- Change the weather
- Generate Plates
- Generate Set Extensions
- Replace Objects
- Relighting and Color Grade
- Rotoscoping and Keying
❤️ Runway Aleph
Testing giving VFX instructions on a marked up first frame ✨
Marked up first frame and original video in comments.
Prompt: 'Leaving the first 10 frames unchanged, add the actions shown in IMG_1'
We've added 5 new tutorials to @runwayml Academy on Aleph, including:
- How to transform videos
- How to generate new angles
- How to generate the next shot
- How to change environments
- How to add scene elements
View them here: https://t.co/Y7Q5QRH5Mp
🧪 Applying Materials to surfaces with Aleph
We start by using Gen-4 images to create a material. I generated the brick wall using the following prompt (1:1 aspect ratio): A spherical Red Blick Wall ball. Set against a pure black background, the sphere floats in an empty space that allows its dimensional form to be fully appreciated.
I then uploaded a video of the girl against a white wall, and the image to Chat-Mode. I then asked Aleph to "Change the wall in the background to the material shown in the image. Keep everything else the same."
That's it. There's no need to render every single iteration until figuring out the final material choice.
The idea of Aleph as a kind of narrative multiverse where every potential branching path of a scene can be simultaneously explored and experienced. All possible endings of a scene.
❤️ Runway Aleph 🔥🔈
Testing combining rapid camera movements with preserving core of base video action.
example: 'leaving the first frame unchanged, move the camera extremely rapidly to an aerial view above this explosion while keeping the focus on the explosion, then zoom the camera out to reveal the entire complex'
Wonder if I can specify the final frame via image reference.
Last video is original.