Damn it worked! Genie 3 world --> inpaint UI --> 4x topaz AI upscale --> train 3d gaussian splat
You can step inside a painting of Socrates from 1787. Better than any image-to-3d model I've seen.
I think Google has stumbled upon the killer app for VR -- the literal holodeck.
omg.. this cant be real
China’s 4DV AI just dropped 4D Gaussian Splatting, you can turn 2D video into 4D with sound..
imagine.. we will be able to change camera angle, zoom in/out while watching movies
5 examples:
Today is a big day at @odysseyml.
We're sharing Explorer, our first generative world model. We think world models are the next frontier for AI, enabling wonderful new things.
To help shape this, Ed Catmull, the iconic founder of Pixar, is joining our board and investing.
Volumetric Capture is Hard
There is no magic solution. Anyone interested in spatial R&D can get access to some awesome datasets online to test with, which can be especially interesting when processed with 3DGS and played back as 4DGS. However you need a ton of compute power. (multiple 3080, 3090+, RTX5000+ etc)
https://t.co/gepgOkKCGU
The Necessity of Multiple Cameras for Volumetric Capture
Consider, for instance, this very useful fixed rig dataset comprising 20 camera streams provided by Facebook Research
https://t.co/9WmYyX8T5v
Or this datasets comprising 40 camera streams provided by Google
https://t.co/B3dJQ5xTFG
The attached video demonstrates FB's RAW 3DGS data played back in real-time in our custom Sibr viewer.
It's noticable how quickly the quality can breakdown out of the camera group frustrum. Even at this quality it takes a lot of time and energy to process and playback. It's not simple. Let alone the expertise required by the original research team who captured the data.
Doing this with 20 cameras is hard. 150+ cameras even harder. Now imagine trying to achieve it with a single camera phone to playback on a Meta Quest or Spatial headset.
#volumetriccaptureishard #camerasdontseearoundcorners #spatial
Dynamic 3D Gaussians: Tracking by Persistent Dynamic View Synthesis
https://t.co/rTiKZhEjXM
We model the world as a set of 3D Gaussians that move & rotate over time. This extends Gaussian Splatting to dynamic scenes, with accurate novel-view synthesis and dense 3D trajectories.
Check out this new Canadian podcast from my dear friend Sarah. She and her colleague Kim speak to @iamjamgamble about turning your voice into your ultimate superpower and building your confidence. #showyourstnce#RealTalk#confidence
https://t.co/hOyAfC0Bvp
Scientists have fabricated a deformable, hydrogel-based sensor directly onto a continuously inflating and deflating pig lung, demonstrating a new 3D printing method that estimates surface motion in real time. https://t.co/NVo9QBTgJQ
PK Silver. An evidence-based program for adults over 50 (no upper age limit with doctor's permission) includes movement games and obstacle courses. In general, obstacles are at ground level or just above.
https://t.co/fcfh6UKMWb
Thoughts?
Personalized VR memory palaces are totally going to be a thing!
"We found that virtual memory palaces in HMD condition provide a superior memory recall ability compared to the desktop condition."
I am excited to announce that Ryerson University will be hosting the inaugural Canadian Stress Research Summit in April/May 2020! We have two incredible Keynote Speakers to kick off this national conference. Visit the website for more information: https://t.co/fbGwRGyi4K