Here is a screen recording of the real-time demo in Quest 3. We are working on the ultra-high-quality 360 reconstruction of dynamic scenes for a fully immersive demo. Stay tuned!
Beyond photos/videos, what's the next medium for sharing visual experiences? 🤔
NeRF/3DGS are great but only capture a static 3D world and ignore ambient scene dynamics.
In this paper, we show how we can reconstruct/render these essential scene elements even with a single causal video.
What a journey! Thank you @jbhuang0604, for all your support and help along the way! Could not have done it without your support! Also, I am very fortunate to have these awesome committee members.
Next stop: I'll be joining @JPKopf's team at Meta as a Research Scientist!
Congrats Chen Gao (@gaochen315) for passing the PhD defense!! 🥳
Special thanks to committee (Lynn, @berty38, @JPKopf, Harpreet)!
Chen’s PhD made solid contributions to computational photography/videography. Follow his work!
https://t.co/7GCNR5IpaI
SUPER excited to share our work Dynamic View Synthesis from Dynamic Monocular Video! Check out our fun teaser video 😎!
Paper: https://t.co/V8819QX12n
Project: https://t.co/eYjqxdzvzP
w/ @gaochen315, @ayush29feb, @JPKopf
Omnimatte: Associating Objects and Their Effects in Video
pdf: https://t.co/z1LLzborDK
abs: https://t.co/ylCWjre2oh
project page: https://t.co/5m7IsONaEj
Want to improve the data efficiency of your semantic segmentation model?
Check our recent #ICLR2021 paper "PseudoSeg: Designing Pseudo Labels for Semantic Segmentation"!
Code: https://t.co/EZgjag4ChI
Project: https://t.co/0mmG9uDpvd
See you on 3rd May 5-7 pm PDT/ 8-10pm EDT!
The Google Colab of our video completion is up! Now you can edit the video (e.g. removing objects, FOV extrapolation) with one click!
https://t.co/DU7LJHfUlr