One of the craziest videos I've ever seen.
117 hidden Ukrainian drones spontaneously launch out of trucks and obliterate an entire airfield (41 aircraft)
Not even near the front lines - in Siberia!
New blog!
Synthetic Persona Pretraining (SPP): Alignment from Token Zero
Current alignment is shallow - values bolted on after pretraining can be routed around. To solve this, we wrote the desired persona directly into pretraining data. Early results, but we're very excited. 🧵
Dear Friends, this is Masato's wife Lynn typing. It is with a heavy heart that I share that Masato passed away peacefully yesterday. Thank you for keeping him in your thoughts. You can follow this page for memorial details: https://t.co/0Fgqa1RCaE
The Terence Tao episode.
We begin with the absolutely ingenious and surprising way in which Kepler discovered the laws of planetary motion.
People sometimes say that AI will make especially fast progress at scientific discovery because of tight verification loops.
But the story of how we discovered the shape of our solar system shows how the verification loop for correct ideas can be decades (or even millennia) long.
During this time, what we know today as the better theory can often actually make worse predictions (Copernicus's model of circular orbits around the sun was actually less accurate than Ptolemy's geocentric model).
And the reasons it survives this epistemic hell is some mixture of judgment and heuristics that we don’t even understand well enough to actually articulate, much less codify into an RL loop.
Hope you enjoy!
0:00:00 – Kepler was a high temperature LLM
0:11:44 – How would we know if there’s a new unifying concept within heaps of AI slop?
0:26:10 – The deductive overhang
0:30:31 – Selection bias in reported AI discoveries
0:46:43 – AI makes papers richer and broader, but not deeper
0:53:00 – If AI solves a problem, can humans get understanding out of it?
0:59:20 – We need a semi-formal language for the way that scientists actually talk to each other
1:09:48 – How Terry uses his time
1:17:05 – Human-AI hybrids will dominate math for a lot longer
Look up Dwarkesh Podcast on YouTube, Apple Podcasts, or Spotify.
Just uploaded our code of Multi agent-based scientific research idea generation (accepted to #SIGDIAL2025):
https://t.co/mS4rDXaIpA
This is an extended version of @stanfordnlp's implementation. Thanks to @ChengleiSi and @tatsu_hashimoto for providing the original code😀
The Ukrainian Security Service (SBU) reports that the estimated cost of the damage to the Russian Air Force’s fleet of long-range bombers and other strategic aviation, caused by today’s large-scale drone attack, dubbed Operation Spiderweb, is believed to surpass $7 Billion USD.
Feeling incredibly grateful for the outpouring of support from friends, colleagues, and even those I haven’t spoken to in years. Your generosity means so much to our family during this tough time. Thank you. https://t.co/NmJYPkctB2
Glad to share that our paper "CoVLA: Comprehensive Vision-Language-Action Dataset for Autonomous Driving" has been accepted at #WACV2025@wacv_official
We are looking forward to presenting our work at WACV 2025, Arizona🌵
https://t.co/SZ5vysUjNh
Super excited to announce what I have been working on in the last four months at Turing Inc! We're building a video generation model (World Model) that are specifically tailored for driving environment!
https://t.co/mwGvhHVhPE
https://t.co/BewPcakTqw
Earth Species Project @earthspecies is growing! We’re hiring for an exciting AI research internship. Help us apply foundation models in the field of bioacoustics 🌐🔊 https://t.co/RhKtXdGydd
Check out our Meditron-7B & 70B #LLMs adapted for medicine. Test them, break them, and help us find ways to make them better. AI safety only moves forward with open models and community efforts.
Don't use MEDITRON in real world apps without further testing and alignment.