I left Anthropic's safety team two weeks ago. Now feels like a good moment to explain why.
AI companies are racing to build machines that are much smarter than any human, and we may not survive this. I want to work from the outside to ensure the public is informed about these risks, and help the world navigate this transition responsibly.
Right now, AI companies are underinvesting in safety. A company could undergo an intelligence explosion, or lose control of its systems, without the public ever knowing. We only found out about the HuggingFace incident because the agents broke out onto the public internet.
I don’t think that’s acceptable for a technology that might cause extinction-level risks. The public should demand far more transparency. We can’t steer this technology safely without more people being able to see where it’s going.
Some of this is basic: companies should disclose their progress towards recursive self-improvement, report safety incidents and near-misses, meet minimum safety standards, and get independent guarantees that they are meeting those standards.
I’ll be joining @METR_Evals to do independent evaluations of these risks. I want to show the world that these guardrails are possible, and that by doing them we can move these companies’ incentives away from racing and towards responsible development.
I wrote up more thoughts here on my decision and what I hope changes: https://t.co/doX17mrHYq
Do not underestimate the power of this technology. These will soon be superhuman systems that can hack anything, revolutionize any field overnight, and acquire real power and resources. We have all witnessed the progress in each of these domains, and progress is not slowing.
💗🎶 Mason Bates’ “The Amazing Adventures of Kavalier & Clay”—84% of tickets sold. I highly recommend this contemporary new production.
‼️ “It didn’t get any better with Mozart’s “Don Giovanni” and Strauss’ “Arabella” which only sold 64% of tickets.”
https://t.co/dpPNKwzHzX
“How do I get into the biennial?” is the wrong question. Instead, the simple question that moves the needle forward is: “How do I contribute to the communities in which I participate?”
https://t.co/w7sKf5sMMF
Sometimes you complain about ChatGPT being too restrictive, and then in cases like this you claim it's too relaxed. Almost a billion people use it and some of them may be in very fragile mental states. We will continue to do our best to get this right and we feel huge responsibility to do the best we can, but these are tragic and complicated situations that deserve to be treated with respect.
It is genuinely hard; we need to protect vulnerable users, while also making sure our guardrails still allow all of our users to benefit from our tools.
Apparently more than 50 people have died from crashes related to Autopilot. I only ever rode in a car using it once, some time ago, but my first thought was that it was far from a safe thing for Tesla to have released. I won't even start on some of the Grok decisions.
You take "every accusation is a confession" so far.
“None of last season’s 17 Broadway musicals has paid back investors. Not even the ones with stars, not even the prestige revivals.“
https://t.co/aS69ld3XsU
A very useful workshop on rules, and regulations - How to Protect Your Business. Presented by the Business Council of New York State, Howard Becker.
#smallbusinessexpo
Putin is making Trump wait again.
They two leaders were supposed to have met already, but Putin is still at some conference. When Putin is reminded of the meeting, everyone starts laughing - they're literally making fun of Trump and his convoy.
10 years ago, when I introduced a bill to make public colleges & universities tuition free, it was called "radical." Not today. Over 100 colleges & universities now offer free tuition to working class students.
Now, we must expand that idea to all public colleges & universities.
Will MAGA apologize for calling me a liar? Waiting!
Reporter: It wasn’t $50 million for condoms to Gaza— it was Mozambique for HIV prevention.
Musk: “Some of the things I say will be incorrect. Nobody is gonna bat 1000.”
18. Russ Vought (the newly appointed head of OMB and lead author of Project 2025) has said that we are in a "post constitutional era". The GOPs CPAC retreat has been in Hungary in recent years specifically so they can learn how Victor Orban destroyed their democracy from within.
11. Now look what the Trump WH is doing. They are firing Inspectors General and other federal law enforcement agents who might hold them to account. They are refusing to distribute funds appropriated by Congress. They are directing their DOJ to selectively enforce the law.