Radiance Fields

News about radiance fields, including Gaussian Splatting & Neural Radiance Fields (NeRFs).

Dell Precision Pro Ambassador | Khronos Group IC

[Radiance Fields @RadianceFields]

Gaussian splatting was everywhere at @NABShow. Here's a crazy 4DGS capture of me from @4DV_ai right on the show floor.

[Radiance Fields @RadianceFields]

@tjohnell I don’t know the exact printer they’re using, but @Crysta_AI is doing the printing

[Radiance Fields @RadianceFields]

For the people asking about 3D printing gaussian splats, this is honestly amazing.

[Radiance Fields @RadianceFields]

@nnnpppqqq Not cheap, but probably not outrageous. It’s being printed by @Crysta_AI

[Radiance Fields @RadianceFields]

@lithium534 right now the only company that can do it is @Crysta_AI

[Radiance Fields @RadianceFields]

@rezmeram It’s a 3D reconstruction of a real bee using gaussian splatting (No AI)

[Radiance Fields @RadianceFields]

@jasteinerman @CesiumJS That would be epic! Sign me up for next year 😂

[Radiance Fields @RadianceFields]

@sanjuhs123 it’s taken forever

[Radiance Fields @RadianceFields]

Apple may have just launched Spatial Reframe, but Huawei has full on gaussian splatting on lock screens.

[Antoine Guédon @antoine_guedon]

What if you could turn any number of photos (3, 8, 15, or even 60) into one clean 3D surface (pts & mesh) with Flow Matching?

Check out our new work, Surflo: Consistent 3D Surface Flow Model with Global State. 🧵
1/n

🔗https://t.co/lBcJRgpfdg

[Mykhailo Moroz @Michael_Moroz_]

I've been implementing multi-object combined LODs (actual LODs this time) for gaussian splats. It is insanely cool, due to the way I select LOD's I *always* render the same amount of splats no matter how many splats are in the scene. This scene has 108M total combined splats.

[Radiance Fields @RadianceFields]

@gracia_vr @s1ddok @nathanmatsuda Looking forward to it!

[Matthew Harris @HatthewMarris]

got @theworldlabs marble 1.1 splats rendering @ 90fps on @MetaQuestVR. art pipeline is now pure imagination.

[Radiance Fields @RadianceFields]

This isn’t Fable, but is open source

[Ruilong Li @ruilong_li]

With flashdreams, you can also create your own game, without paying anyone! Entirely open-sourced with Apache 2 license.

All from a text prompt and a single image
https://t.co/VOy1ir4o1D

[Radiance Fields @RadianceFields]

@slimbuck7 One day I would like it to be available there!

[Radiance Fields @RadianceFields]

In the summer of 2023, I cold emailed Jensen Huang and asked to capture a NeRF of him at SIGGRAPH. He responded in about an hour and said yes.

A radiance field is, in the simplest terms, akin to a 3D photograph. A moment in time, so completely reconstructed that you can move through it and see it from angles the original cameras never occupied. NeRFs were the original method. Gaussian splatting, which debuted at that same SIGGRAPH, has since become the dominant form of radiance field.

I called my late friend James, who told me we needed to begin practicing immediately. We ran capture after capture for weeks until we consistently got the capture time down to ~30 seconds with one camera. Later, in a hallway at the LA Convention Center during SIGGRAPH, I captured the portrait you're seeing now, a full 360° gaussian splat of Jensen, rendered here as a 2D flythrough.

Afterward, I continued the conversation with him and members of his team to make the case for radiance fields as a foundational representation for imaging. To my surprise, they listened.

Three years later, NVIDIA has several works, including NuRec, fVDB, 3DGRUT, and gsplat all utilizing radiance fields. The landscape has evolved enough that the reasoning is obvious. Gaussian splatting has begun to ship across some of the world’s largest industries, including autonomous vehicles, AEC, geospatial, media and entertainment, robotics, e-commerce, hospitality. It’s become clear that lifelike 3D is here to stay.

And yet I think we will look back and be disappointed by how late we started taking 3D portraits of the people around us, just like how we have sparse 2D photos of our grandparents and great grandparents. We have billions of photographs of the people we know and love, but almost no radiance fields of them.

I'll be returning to SIGGRAPH in LA where this was initially captured three years ago, with the landscape looking significantly different. Radiance fields are more under deployed than ever relative to what they can do.

I'm excited for the future of imaging, and for 2D to transition into 3D. I have a few things up my sleeve that I think will make that case plainly.

[Radiance Fields @RadianceFields]

@flyonthewallet This was taken with video, purely out of necessity. I made a windshield wiper motion around him, with a final pass completing a 360

[Radiance Fields @RadianceFields]

@Scannerian1 Thank you Ian! I hope you’ve been doing well

[Radiance Fields @RadianceFields]

@bilawalsidhu I was so relieved to run into you that morning! I was very nervous 😂

[Dany Bittel @DanyBittel]

If a rock could tell a story, this ones a whole book. A Gaussian splat of part of a rock. f/11, 1/160s, 114 perspectives with 62 stacked photos each. 5.0 M splats. Check out the interactive version 👇

[Radiance Fields @RadianceFields]

The splats have hit Apple Maps for some users already.