๐ Introducing our recent work, PixWorld, on scene reconstruction and generation.
๐งฉ It's a unified pixel-space diffusion model that directly optimizes into a scene-level 3D Gaussian Splatting (3DGS) representation via differentiable rendering โ no VAE/RAE needed.
๐ฏ Flexible input: single image, multi-view images, or text โ all unified in one framework, all outputting a full 3DGS scene.
โก Faster: 4-step distilled โ ~0.6s/scene, up to ~1000ร faster than diffusion world models.
๐ https://t.co/hfb0RUJQpS
๏ฟฝ๏ฟฝ https://t.co/zuIFtkGZ8Q
๐ป https://t.co/ohDK5RfpXa
๐ค https://t.co/sBvsuFu40H
PixWorld โ Unifying 3D Scene Generation & Reconstruction in Pixel Space.
Prior work splits the two into different spaces โ reconstruction in pixel space, generation in latent space. PixWorld unifies both in one pixel-space diffusion model, and instead of optimizing an intermediate latent it optimizes directly into a 3D representation via differentiable rendering (no VAE/RAE).
โก 4-step distilled โ ~0.6 s/scene, up to ~1000ร faster than diffusion world models.
๐ https://t.co/oFUqKacZj2
๐ https://t.co/OaysMDJFTK
๐ป https://t.co/rNsWwIa3JS
๐ค https://t.co/42tIq5mnkf
Paper & project page are live โ feedback / RTs / โญ / upvotes welcome! ๐