Who knew PMF for MediaPipe hand tracking would be performance art for social media :)
One of the unpredictable things about vibe coding is it breathes new life into tech that's been around for ages and gives it a new audience. Threejs is another example.
Reconstructing the world in 3D from random internet photos is a deep rabbit hole.
In 2008, Photosynth proved that 3D reconstruction of smaller monuments was possible. The next year, "Building Rome in a Day" proved it could be done for entire cities.
Since then, there’s been a wild lineage of research from early point clouds to modern NeRFs and 3DGS --with a similar cast of characters appearing along the way.
In this deep dive, we'll break it all down, and explore why IARPA is funding what comes next.
0:00 The Internet's 3D Model of the World
0:40 Building Rome in a Day (2009)
2:09 The Long Tail Problem
3:18 MegaDepth and the Mannequin Challenge
4:44 NeRFs and 3D Gaussian Splatting
7:19 MegaScenes, Doppelgangers, and Foundation Models
10:00 MegaDepth-X Punches Through the Wall
11:26 Why IARPA Is Funding What's Next
13:51 The 4D Frontier and the Sensorium
God’s Eye View V1 is open source. It feels like a spy simulator in your browser -- except the underlying data is real, and you can talk to the planet too.
Track planes, ships, satellites, traffic cameras, and critical infrastructure. Use voice mode to ask what’s happening, annotate the 3D world, or jump into a plane’s cockpit.
Already a ton to explore. Code is MIT licensed, so add new layers, extend the voice agent, break things, and show me what you cook.
Using voice mode to monitor rush hour traffic in God's Eye View. It uses aggregated location data from TomTom to visualize how busy every road segment is.
And in cities like Austin and London you can look at public CCTV cameras to confirm the actual conditions on the ground.
Open source and MIT license. 8k+ stars on GitHub.
God’s Eye View is on GitHub Trending. MIT license.
Use voice commands to “jump into the cockpit of the nearest helicopter or jet” or ask “how many military flights are in this region”
Turning the 3d globe into a canvas you can annotate w/ voice is really quite fun.
If you look at the state of the art in procedural 3d generation then you’ll quickly realize that language models will make a serious dent in controllable world building - manifesting whatever we want into existing 3d tools like houdini, blender or unreal.
Free viewpoint video with 4x iphones is genuinely nuts.
This used to need a volumetric capture rig with dozens if not hundreds of cameras.
Offline renders are just the start. Can't wait till we can playback dynamic 3d content like this in real time.
4D reconstruction of the Amazon Prime Air cargo plane crash at Miami International Airport.
You can see the plane overrun the end of Runway 30, cross the airport perimeter, and come to rest roughly 1,300 feet beyond the paved surface.
Built using public flight data, eyewitness footage, and ATC excerpts. Precise cause is still TBD per today’s NTSB update.
God’s Eye View blew up and hit #1 on GitHub Trending.
Two big questions kept coming up: how do I run it if I’m not a coder, and can you give me a full walkthrough of everything it can do?
I'll cover both today. Use timestamps to jump around.
CHAPTERS
0:00 Launch Reception
1:06 Install God’s Eye View
2:08 The Interface, Flight Tracking & Radio
5:51 Contacts Mode & Cockpit View
7:47 Control the World With Your Voice
11:25 Area 51 Easter Egg
12:40 Traffic & Public Cameras
15:55 Track Ships & Ride Along With Flights
19:55 Record Your Own Camera Tours
21:06 Fires, Earthquakes & the Physical Internet
24:18 Reconstructing Nepal Floods
25:55 Building God’s Eye View Together
Created a 3D scan of the Amazon Prime Air crash site in Miami using newly released NTSB footage.
You can see the two vehicles impacted after 21 Air Flight 7598 overshot the runway, and the skid marks leading up.
Link below - explore the 3d gaussian splat, site photos, and replay the landing with flight tracking data and ATC audio.
Made with COLMAP, LichtFeld Studio, GEV and Astra.
All 4.5 years of the war in Ukraine through satellite fire detections. You can see the border line up clearly in waves. Staggering to see it from this point of view.
🚨 ملياردير جلس لمدة 42 دقيقة فقط وشرح كيف يعمل الاقتصاد العالمي بالكامل.. أفضل وأبسط من برامج MBA تكلفتها 50,000 دولار! 🤯
بدون فلسفة أكاديمية معقدة ولا معادلات مملة.. قواعد اللعبة المالية الحقيقية وكيف تتحرك الثروات والديون في العالم كما لم يشرحها لك أحد من قبل!
42 دقيقة ستغير طريقة فهمك للمال إلى الأبد..
احفظ التغريدة وشاهد الفيديو التاريخي فوراً! 🎬👇
✈️ عرض جوي حقيقي فوق San Francisco
أعيد بناؤه بالكامل كنسخة رقمية ثلاثية الأبعاد من بيانات الطيران فقط
Bilawal Sidhu أعاد تجسيد عرض Fleet Week داخل توأم رقمي واقعي للمدينة
🛰️ كيف صنعه؟
▫️ استخدم بيانات تتبع حقيقية لمسارات الطائرات والسفن
▫️ محرك الكاميرا يقرأ بيانات الطيران ويلاحق كل طائرة تلقائيا
▫️ ويبطئ اللقطة ويسرعها في اللحظة المناسبة تماما
🌍 أين يمكن استخدام هذه التقنية؟
▫️ إعادة مشاهدة أي حدث في أي مدينة من زاوية علوية
▫️ التخطيط للفعاليات الكبرى وحركة المرور
▫️ وصناعة محتوى وثائقي دون طائرات تصوير
🎬 مفيدة لصناع المحتوى ومخططي المدن وكل من يعمل في البيانات المكانية
قريبا لن تحتاج أن تكون حاضرا لترى الحدث
يكفي أن تكون بياناته موجودة
The world's first floating production storage and offloading (FPSO) vessel with a carbon capture and storage facility was delivered in Shanghai on Monday.
Πιστεύω πως οι πιο όμορφες και γλυκές μέρες
δεν είναι εκείνες στις οποίες συμβαίνει κάτι εξαιρετικά λαμπρό,
θαυμάσιο ή συναρπαστικό,
αλλά εκείνες που φέρνουν απλές, μικρές χαρές,
διαδοχικά και απαλά,
σαν μαργαριτάρια που γλιστρούν από ένα νήμα.
Literature laureate Han Kang’s physical empathy for extreme life stories is reinforced by her increasingly charged metaphorical style.
희랍어 시간 (‘Greek Lessons’, 2023) from 2011 is a captivating portrayal of an extraordinary relationship between two vulnerable individuals. A young woman who, following a string of traumatic experiences, has lost the power of speech connects with her teacher in Ancient Greek, who is himself losing his sight. From their respective flaws, a brittle love affair develops. The book is a beautiful meditation around loss, intimacy and the ultimate conditions of language.
#NobelPrize