one of the biggest obstacles in ai video is fine-grained control of what the actors do in a scene, and iterating on it.
blocking the scene out in blender, then running video-to-video with a reference image for the look, has been done before. but it made every iteration ten times slower
we’ve removed that barrier by hosting blender in the cloud. now you can have agents building different scenes side by side, nailing every small detail, with full control of sequencing and timing
your agents can now run 10s of parallel cloud blender sessions via the patch CLI!
> knock this tower down in 16 different ways and keep the best take
https://t.co/cfCcsYeRLs
Introducing cloud blender on patch: real Blender sessions and GPU renders it runs by itself, 16 at once! Now your agents can spawn as many blender instances as they want, and they wont hog your local computer resources :)
https://t.co/VnJJnpHj3v
If you're in SF for the Unreal Engine MegaJam, we're hosting an afterparty at our place! If you're interested in the gaming space, you should come over :) https://t.co/cVqV8BqOfC
built a small western town with Fable 5.2 and @startvoyager's vork.
blender builds it from python, board by board, and notes how much weather each board takes: sheltered under an eave, or out in the sun and rain.
vork ray-traces it ages the wood to match. under the eaves the paint holds and the wood stays brown whereas exposed wood's paint flakes off and the bare wood bleaches grey, like an old fence.
fable 5.2 + ai video is the new mocap
left: a clip from an ai video model
right: the same moves solved onto a real 3d samurai rig by anymove. no mocap suit, no keyframes, katana included. the colours are how it tells each limb apart
open source: https://t.co/5PVM908XvK
i used fable 5.2 to make this "hand-painted" game in less than an hour
Every frame is about 1.5 million brush strokes, running at 200 fps in a browser tab. Open source too!
every part of a game is a block.
pull it out. build on it.
it's time to get everyone in the industry building together
the future of gaming is open source
Introducing patch: build and play games.
- Every game dev tool in one CLI and MCP
- 50,000+ open-source assets
- Remix any game on patch, or mod the ones on your PC
- Ship it to everyone on patch, opensource :)
We're opening it to everyone today: https://t.co/WkZvxtLuDE
Introducing patch: build and play games.
- Every game dev tool in one CLI and MCP
- 50,000+ open-source assets
- Remix any game on patch, or mod the ones on your PC
- Ship it to everyone on patch, opensource :)
We're opening it to everyone today: https://t.co/WkZvxtLuDE
I've been diving into the new WAN 2.2 video model—just a minute to go from i2i to i2v. The result? Stunning, seamless videos. It's free, open-source, and ready to roll with the latest models on @comfydeploy!
https://t.co/qq0Ctn4phR
My @WAN test using my Video Prompt maker I made a while ago https://t.co/kKCZ0OqMou
using qwenVl2.5 @ComfyUI
I am using @comfydeploy
all of this work so well
my 2024 wrapped, from indie hacking to YC
- left my previous company after 3 year of building, literally tears up in our last convos
- girlfriend broke up with me
- started indie hacking
- went viral with open sourcing @comfydeploy
- met @nicholaskkao on twitter and he quit his job after our first call to become my cofounder
- incorporated two weeks after we meet, literally a leap of faith
- went to SF to meet Nick first time in person and we did YC interview at a wework
- we thought we flopped, but got in on march 15
- had a blast in yc, once in a lifetime experience, cant express with words, but it’s crazyyyy
- went travel a bit for ComfyUI events and seeing friends in Japan + Taiwan post YC
- now back at where I started in my parents house, spent some quality time together.
Main takeaway - Maximising for failure! This is how to learn and grow
Just redesigned and shipped the entire @comfydeploy machine page in just HALF A DAY – and here's how:
- Reimagined the page's architecture with @AnthropicAI's Claude 3.5 Sonnet
- Rapid-prototyped with @v0 + @shadcn UI chart, keeping the UI top-notch
- @cursor_ai's composer slashed my dev time 10x
Dev just got a serious upgrade 🚀