Capt.#9

3D artist, NFT aficionado, AIporn Maker!

[Elon Musk @elonmusk]

Just a reminder that you can always access this platform via https://t.co/bOUOek5Cvy, even on your phone. No app is needed.

Now would also be a good time to download a VPN in case you get blocked.

[Capt.#9 @centurio_ix]

@0xgaut sell tickets and snacks to my imaginary friends!

[Capt.#9 @centurio_ix]

@InternetH0F that's asmongold house!

[TheJPEGGallery ⌐◨-◨ @thepropgallery]

Let’s help the under 10k follower artists, post below I’ll share as many as I can

[Capt.#9 @centurio_ix]

@timsoret @Aleksa_Topuzic a lot of fear of new technologies, but in capable hands these AI tools will enhance artists!

[Capt.#9 @centurio_ix]

@HoussineMehnik finally out, awesome I'll start using it right away!

[Elhoussine Mehnik 🪁 @HoussineMehnik]

Release a simple "Free" #UE5 plugin allowing to convert a PaperSprite to SkeletalMesh :)
https://t.co/8oRjX6aPuT

#UnrealEngine #UnrealEngine5 #gamedev

[Capt.#9 @centurio_ix]

@PixSorcerer i hate this fucker!

[Capt.#9 @centurio_ix]

@2D_OS_GAMES love how it looks, what software are you using to animate?

[80 LEVEL @80Level]

Check out the mind-blowing experiments of @dante_leoncini, a 3D Artist and Programmer, who managed to run Blender on an 18-year-old Nokia phone.

Now I've seen everything: https://t.co/h7E1cXKCzT

#blender #blender3d #b3d #blendercommunity #nokia #mobilephone #3dsoftware

[SUPERMINILUX 🚀 @SuperMinilux]

@80Level @dante_leoncini Good, make an iPad version now

[Capt.#9 @centurio_ix]

@80Level @dante_leoncini we need blender on ipad

[Capt.#9 @centurio_ix]

@LucianoFinanzas esta es la gente que cree en Newman Pérez y Cossío, lo peor de todo es que volverán a caer en unos meses cuando salga otra!

[Capt.#9 @centurio_ix]

@DeLos25467 @LucianoFinanzas cualquier persona se puede tomar fotos con el fondo de una publicidad de cualquier compañía en alguna expo o Meetup!

[Capt.#9 @centurio_ix]

@Josebernar98921 @senorbolainas10 @LucianoFinanzas aprovechando la 🌊 ponzi ?

[Elon Musk @elonmusk]

It’s patently absurd that Apple isn’t smart enough to make their own AI, yet is somehow capable of ensuring that OpenAI will protect your security & privacy!

Apple has no clue what’s actually going on once they hand your data over to OpenAI. They’re selling you down the river.

[Capt.#9 @centurio_ix]

@GameRollGTA @DailyLoud we will end up playing fallout soon!

[Capt.#9 @centurio_ix]

@CorpoelecInfo @normawil1771 EPA @CorpoelecInfo el sistema de pagos de la web está cobrando pero no libera la deuda, el banco de Venezuela hace el cobro pero la web no muestra la deuda pagada y ya se llevó el dinero. se perdió el dinero o hay donde llamar y reportar esto?

[Bilawal Sidhu @bilawalsidhu]

When Apple said they were rolling out 'spatial media' this is what I actually expected - 3D video with six-degrees of freedom.

Instead Vision Pro users got old wine (VR180 video) in a new bottle (Apple's MV-HEVC format).

Conveniently, here's an open source NeRF-based volumetric video engine, with WebXR streaming to Vision Pro and Quest. Oh and it supports Mac too. All this from a little known company called Lifecast (YC '21).

Let's dive into their new paper "Baking Neural Radiance Field Video to Immersive Layered Depth Images" - which aims to prove that volumetric video capture, editing and playback is very possible on today's hardware.

🔴Central Approach: Multi-View Video → NeRFs → LDIs

You can also use a simple VR180 camera (e.g. Canon R5C) or a big ball of cameras (GoPros) to capture 3D video of a scene, make some NeRFs, then bake it down into a Layered-Depth Image (LDI) based video format.

It's kind of like taking a detailed, hand-crafted sculpture (the NeRF) and then creating a simplified, 3D-printed version (the LDI) that captures the essence of the original, but is easier to distribute and display.

According to the paper, it's a 3 layer LDI - which isn't super high but still a pretty substantial jump up from flat stereo. However, the reason for the authors sticking to just 3 layers is very practical.

🔴Why 3 Layers is a Sweet Spot for Volumetric Video

Turns out you can can easily pack a 3x3 grid of 1920x1920 resolution layers into a 5760x5760 image - which is the max resolution video most VR headsets (with mobile chips) can decode.

Plus, the paper uses an equiangular (vs. equirectangular) projection which keeps the pixel density in the center region comparable to "8K" resolution 180° VR video. That's quite the sweet spot IMO.

🔴Things Move Fast! Yet Old Ideas Often Find New Homes

Low key stoked to see 'LDIs' and 'equiangular projections' being used to bake out these 4D radiance fields. Circa 2017-2020 my team at Google used exactly these approaches to enable light field video (@broxtronix et al) and high resolution video streaming on YouTubeVR.

What's wild is 4 years later this paper brings a 238x speedup vs. the Deep View Video paper - and the pipeline can be run on a single GPU workstation vs. a Google datacenter.

🔴Closing Thoughts

IMO, the visual fidelity is still not there with complex subject matter - like, 3 layers will only get you so far.

But what this paper/pipeline proves to me is that high res volumetric video streaming is absolutely possible on mobile hardware.

A simpler 3 layer format like this could also make editing of volumetric video in existing tools like premiere/resolve a lot easier than we might have expected.

[Elon Musk @elonmusk]

Yup