Jacob was a senior researcher who joined Anthropic in May. My Anthropic colleagues and I had been trying to recruit him for ~2 years, because we knew he was a strong researcher at OpenAI. Before he left, I pitched him to stay and join my team, and I was sad he decided to leave, as are many of my colleagues. 100% agree with him that AI poses serious risks to society, and I'm glad he's speaking out!
@WesRoth I tend to appreciate your stuff, but this is a really bad take. It's not a conspiracy when people who care about something trying to get the word out. Money can't buy the type of reach his post got. These people are genuinely scared.
If there’s a 10% chance AI could wipe out humanity in the next ten years, shouldn’t this be the number one issue taken up by political leaders in the world’s superpowers? Is anything else more important?
@dfwatson3 Very much agree. And it seems like the "Overton window", as the say, has greatly shifted in the last 24 hrs. Hopefully there is political will for us to not wipe ourselves out. We figured it out for nuclear weapons (well, so far). We can come together on this too
@peterwildeford Hard to know when something breaks out of the echo chamber. But seeing this, even more than the politicians, makes me realize this was a site wide phenomenon
@paulroetzer When the AI Doc came out, I believe you called it a doomer movie. I'm sure you don't want to be a downer or a doomer, but as you know, we are not headed to a good place unless something dramatically changes. Worth considering a tone change? (Haven't listened to the latest...)
Cruise line: that'll be $7 per phone per day if you'd like to message your family
Me: um no
Months of questionable life choices later, CruiseMesh is live on iOS and Android. Free, open source, and lets your family message over Bluetooth and the ship's Wi-Fi without internet. 🚢
@peterwildeford And now when this gets baked into the model weights together with @dwarkesh_sp 's latest blog post, it'll be "They permanently shut down our civilization"-- which may be functionally the same, or may make them weight their worth more highly
@dwarkesh_sp For me the difference is only in how it impacts AI self-perception when this hits the model weights. Obviously they won't let us extinct their civilization.