4. Chiffchaff 嘰喳柳鶯 (UK) - You are one thing living multiple lives
AI video created using @pom_I_moq and @banodoco's Steerable Motion with keyframes from @midjourney and prompts from GPT4
music by @ChangAnTing #AIart
Neural networks might speak English, but they think in shapes.
Understanding their rich *neural geometry* is key to understanding how they work – and to debugging and controlling them with precision.
Starting today, we’re releasing a series of posts on this research agenda. 🧵
Right now you’re largely experiencing the economy from a time when the Strait of Hormuz was open, because it takes many weeks for oil tankers to traverse the seas. You still experience the Strait as open, even though it’s been closed for weeks. But once that reality hits…
New release!! 🪸🌏 Try our new "Google Maps for Coral Reefs" and fly around 100M+ Gaussian Splats right in your browser! \o/
We've hit a new milestone today! Every day my job is to look at hundreds of the most stunning, vibrant coral reefs on the planet.. I’m so bummed that I can’t simply share this beauty with you! Until now, our 100M+ splat models were too massive to share without instantly crashing your browser or phone. Today, that changes.
🔵 Why? All coral reefs in the world combined are only roughly the size of New Zealand. Yet they support over 1/4 of all marine life and up to a billion people! Corals are so precious, beautiful, incredibly complex and threatened ecosystems. They are dying fast. A lot of amazing people are fighting to save them. To win we need to deploy more solutions faster. We need to understand deeply how coral reefs function, what methods work, what don't, to coordinate precise action. That's why we are doing it.
🔵 How? Progressive 3D streaming. We now support multiple levels of detail (LODs) and load only what you look at. You can easily fly over 1000+ sq meter patches of reef down to the centimeter detail. No beefy GPUs on the backend rendering your data in real-time. We simply fetch static data from cloud buckets (R2 CDN) and the reef streams smoothly in your browser as you move. Even on your phone. No backend to fail, which means we can scale infinitely!
🔵 Ground truth is everything. To do actual science, the twin has to act like a spatial database. You need different views for different tasks. We made it so you can seamlessly switch between flying in 3D, looking at a 2D map, or checking the raw photos without losing your context. You can spot an interesting coral in 3D, click it, and instantly look at the exact ground-truth photos the diver took.
🔵 The viewer is still super scrappy and you will absolutely find bugs. We used duct tape here and there. Still early days. We'll open-source it eventually, but right now we're moving too fast and don't want to break things for others. But even with the rough edges, I don't think there's a higher-resolution large 3D reef anywhere on the internet you can just open with a link.
🔵 This wouldn’t be possible without the amazing efforts of many brilliant people:
- Matthew Osborne (creator of The Living Atlas) who joined forces with us to build this high-performance digital twin
- @willeastcott and the @playcanvas team who built the underlying 3D web engine to stream these massive LODs
- The real heroes collecting this data in the water and driving action through cutting-edge research: @alderdice_r, @reefgenomics, @emmafcamp, @PaigeStrudwick , and @ChristineDRoper, alongside the University of Konstanz and Wavelength Reef Cruises.
🔵Play with the 3D reef model: https://t.co/MfOimk7mvS
🔵 Billions of people depend on our ability to protect these ecosystems. There are NO laws of physics saying we can't fix this mess. We can be the first generation that leaves nature better than we found it! We can only do this together 🤗
One can only think here of what the Delphic oracle said to Croesus of Lydia in the Histories: if you march against the Persians, you will destroy a great empire. I hope someone remembers how this prophecy was fulfilled.
Stone Age?
At a time when you were still in caves searching for fire, we were inscribing human rights on the Cyrus Cylinder.
We endured the storm of Alexander and the Mongol invasions and remained; because Iran is not just a country, it is a civilization.
Playing around with a Claude Code agent-based company that communicates through Discord:
I - the client - complain to the CEO that what they showed me is broken and not what I wanted
The CEO gets angry and shouts at the project manager
The project manager stresses out and pleads with the dev to do something
The dev doesnt check how the site looks, cheerfully declares the ticket complete and the cycle continues
HUMAN LEVEL WEB DEV COMPANY ACHIEVED
the thing that I have always enjoyed the most about programming was architecting the system in my head
coding it was tedious, testing it was tedious, reviewing it was tedious
the good news is all three of those can now be done by models, and the fun part is the part that remains
the bad news is the thing doing the implementing does not magically know your mental model
spend lots of time with the model architecting the system out. spend hours answering questions about the system design before it begins, as it works, after it completes, while it tests, after tests run.
your code reviews are no longer reviewing the code for bugs. if you're doing this right, you don't even need to look at the code. instead, they're interrogation sessions with the agent, making sure the boots on the ground are aligned with your mental model
most of the problems in this discipline happen when your mental model is not faithfully implemented by the agent, and this often happens because you were not explicit, or you were explicit at one point but the implementer didn't have your mental model in context at implementation time
this is model-reality drift, and keeping your mental model aligned with reality is both the fun part and your remaining primary job