This paragraph by Haruki Murakami hits hard:
“Once the storm is over, you won’t remember how you made it through, how you managed to survive. You won’t even be sure, whether the storm is really over. But one thing is certain. When you come out of the storm, you won’t be the same person who walked in. That’s what this storm’s all about.”
I saw a post on Reddit today about AI that said, “AI is data, and data can only look backwards. Creativity looks forwards.” And I genuinely need to sit with the weight of that for a while.
After a certain age, you are no longer the product of your environment or how you were raised. It's a personal choice to live the way you do. At some point, blaming your past becomes a distraction from your future.
Healing is your responsibility. Growth is your decision
I left @A24 to start Osmo, a storytelling studio with a software factory.
Today, we’re launching @osmo_studio to the public: an end-to-end editable video platform that turns Figma, code and reference videos into fully editable motion.
We also raised a $5M seed to build it.
In anticipation of alignDRAW work being auctioned with @fellowshiptrust next week, I want do a series on behind the scenes of alignDRAW prompts released back in 2015
I will start with "a stop sign is flying in blue skies" that is currently auctioning with @ChristiesInc
To give you a motivation, I need to explain you some technical details behind alignDRAW.
alignDRAW is a machine learning model was trained to generate 32x32 image given a text caption. alignDRAW isn't explicitly given what part of text corresponds to the relevant pixels in 32x32 image. It has to figure it out on its own though the "alignment" operator, hence "align" part that is currently known as "attention" in the ML community and broadly.
"alignment" operator was introduced in a hugely influential paper by @DBahdanau@kchonyc and Yoshua Bengio in 2014 "learning to align and translate". by pleasant coincidence and good fortune, @kchonyc became my PhD supervisor a year after alignDRAW was released.
Now coming back to the stop sign flying in blue skies. You see if you downscale the typical image of the road where you usually see stop signs to 32x32 image, the stop sign itself will take only handful of pixels.
So I thought, if alignDRAW model really learned to align "stop sign" part of the text with the relevant pixels in the ground-truth 32x32 image, it should generate a stop sign in any background I try. so I picked blue sky because I personally like color blue, and it's something calming about blue skies that can also offer a nice contrast with color red of stop sign.
The generated images of "a stop sign flying in blue skies" prompt pleasantly surprised me. and if my memory serves me well, "a stop sign is flying in blue skies" was one of the first in the series of non-sensical prompts shown on page 2 of my paper "Generating Images from Captions with Attention" that I tried
okay this is wild. matrix made a new film on its own: "POV: explain 2026 to a kid from 1994"
fable 5 wrote the script, did the storyboards, controlled every shot. zero humans in the loop.
and it's actually good. like, genuinely moving.
we used to make movies about ai. now ai makes movies about us.
RIP expensive video shoots.
I tested Seedance 2.0 4K inside @capcutapp
I wasn't expecting AI-generated videos to look this polished.
Here's what genuinely surprised me:
Character consistency was AI video's biggest wall.
Seedance 2.0's native 4K + Nano Banana Pro just cleared it. Shadows, skin tones, edge detail, all holding up even in motion.
Look at the reference sheets below, then watch the shot. Bezalel, Sabaka, the whole camp. Every face locked to its reference across one continuous take, zero drift.
The sheet even maps his run: a red path tracing his route through the tents before he collides with Sabaka.
THE BOOK OF MOSES premieres Friday. 🌊
Seedance 2 has insane motion adherence.
This was a test to see how far I could push camera control by using a Blender previz as the guide in Comfy.
The model had three inputs:
- the Blender previz
- a reference frame for the upright world
- a reference frame for the upside-down
Two years ago I became obsessed with making AI videos.
No filmmaking experience. Just a genuine love for the craft.
My only real goal has been to make the best videos I possibly can.
Last week, this spec ad I made for @Redfin was nominated for AI Commercial of the Year at the @generatedawards.
The category included work from @Google, @kfc, and @runwayml (congrats @jforozcop for the win)
Still not exactly sure what the Generated Awards are, but it feels pretty good.
Really gratifying to follow your gut and actually see progress.
Onto the next one.