Today, we release Inductive Moment Matching (IMM): a new pre-training paradigm breaking the algorithmic ceiling of diffusion models. Higher sample quality. 10x more efficient. Single-stage, single network, stable training. Read more: https://t.co/pewpFNtJAX
Image to Video with #Ray2 is here. Drop any image into Dream Machine to make it a video and bring it to life — from historic artifacts and paintings to memes, custom art and photos of any kind. Available now.
Introducing Ray2, a new frontier in video generative models. Scaled to 10x compute, #Ray2 creates realistic videos with natural and coherent motion, unlocking new freedoms of creative expression and visual storytelling. Available now. Learn more https://t.co/jGI6KmRQpR.
Decentralized Diffusion Models power stronger models trained on more accessible infrastructure.
DDMs mitigate the networking bottleneck that locks training into expensive and power-hungry centralized clusters. They scale gracefully to billions of parameters and generate photorealistic images with just a week of training on eight independent GPU nodes. They’re easy to implement, adopt DiT hyperparameters directly and outperform standard models FLOP-for-FLOP.
Say hello to the all-new #DreamMachine. 🚀 Your visual thought partner—where ideas become reality. Ideate, visualize, and share your ideas with the world. Available now.
Excited to announce our latest paper analyzing the computational tradeoffs between image synthesis approaches. We compare the text-to-image capabilities of diffusion, next-token, and masked-token prediction across various compute budgets. We also briefly investigate the impact of several modules in the recipe - the autoencoder, conditioning method, and usage of EMA on the model weights.
https://t.co/LMihQsHu8f
Sora is our first video generation model - it can create HD videos up to 1 min long. AGI will be able to simulate the physical world, and Sora is a key step in that direction. thrilled to have worked on this with @billpeeb at @openai for the past year https://t.co/p4kAkRR0i0