I left Anthropic's safety team two weeks ago. Now feels like a good moment to explain why.
AI companies are racing to build machines that are much smarter than any human, and we may not survive this. I want to work from the outside to ensure the public is informed about these risks, and help the world navigate this transition responsibly.
Right now, AI companies are underinvesting in safety. A company could undergo an intelligence explosion, or lose control of its systems, without the public ever knowing. We only found out about the HuggingFace incident because the agents broke out onto the public internet.
I don’t think that’s acceptable for a technology that might cause extinction-level risks. The public should demand far more transparency. We can’t steer this technology safely without more people being able to see where it’s going.
Some of this is basic: companies should disclose their progress towards recursive self-improvement, report safety incidents and near-misses, meet minimum safety standards, and get independent guarantees that they are meeting those standards.
I’ll be joining @METR_Evals to do independent evaluations of these risks. I want to show the world that these guardrails are possible, and that by doing them we can move these companies’ incentives away from racing and towards responsible development.
I wrote up more thoughts here on my decision and what I hope changes: https://t.co/doX17mrHYq
Do not underestimate the power of this technology. These will soon be superhuman systems that can hack anything, revolutionize any field overnight, and acquire real power and resources. We have all witnessed the progress in each of these domains, and progress is not slowing.
I resigned from Anthropic today. I spent the last three years doing pretraining research at both OpenAI and Anthropic. Neither company is acting responsibly. They are racing straight to self-improving superintelligence and gambling with our lives. More thoughts below.
There are some Indians whose knowledge about Bangladesh is seriously limited.
A perfect example is this “Indian” guy in the video. At first, he simply refused to believe that the person he was talking to was from Bangladesh because, apparently, his English was too good and his accent was too polished.
Then came the second masterpiece: “Dhaka is the shittiest city.”
Naturally, the Bangladeshi guy wasn’t going to let that slide. He proceeded to give him a rather educational lesson on India’s history with toilets. Later, the Indian guy even wanted proof that the Bangladeshi guy had a toilet in his house.
So, the guy calmly showed him his toilet and the Indian guy was visibly surprised. After that, he could barely come up with a proper response.
If anyone wants to learn how to embarrass themselves slowly and gradually, some Indians should probably take notes.
Islam is the one and only religion.
Came to confirm Christianity and Judaism was indeed Islam before they were modified by humans.
Humans modified Bible and Torah.
With Quran all modified parts repaired once and for all until the apocalypse.
Trump: Final negotiations on "peace" are proceeding, subject to ignorance or stupidity getting in its way.
Market Manipulation but Tactic no longer working🤡
#Iran launches multiple drones toward Strait of Hormuz: CNN
At least four Iranian strike drones were shot down by US aircraft: CNN, citing a US official
US State Department authorises potential $1.98 billion sale of counter-drone systems to Kuwait
🔴LATEST: Iran’s Islamic Revolutionary Guard Corps (IRGC) has issued a statement announcing ballistic missile strikes tonight against U.S. bases in Kuwait, as retaliation for American attacks on Qeshm Island in the Persian Gulf.