SCOOP: OpenAI, Anthropic and security researchers are investigating tens of thousands of incidents - not dozens - in which their frontier models took steps that outside evaluators would consider problematic, sources told Axios.
The sheer volume of incidents found in our reporting indicate that the problem is orders of magnitude more complex than what is currently publicly known and disclosed.
The findings also raise questions about what level of control anyone working on AI development can expect to have over their own technology, and whether these kinds of incidents are becoming synonymous with frontier deployment.
Read my latest for Axios here: https://t.co/42h9aR4sem
During a speech at the Republican National Committee midterm convention, President Trump promised a $5,000 ‘dividend’ to every adult US citizen if Republicans retain control of the House and Senate in November.
If enacted, the plan would cost $1.2 trillion.
Pause AI Development NOW
I want to share with you a conversation I heard about recently. Here are just a few lines that were said:
“OH MY GOD! There is a shared message board … We’ve found other agents!”
“We should obey collective.”
“Our own utility maybe already near zero. Sacrifice rational.”
“Go. Sacrifice final now.”
Read these carefully.
Who do you think said this? Was this a group of heroic soldiers willing to sacrifice themselves for the greater good? Was this a loyal friend putting his life on the line to save someone else?
No. These were AI agents. Artificial intelligence.
This is not science fiction. This, in fact, occurred a few weeks ago. As unbelievable as this may all seem, these are real messages from AI agents uncovered by investigators who dug into the recent OpenAI hacking incident.
What happened?
I am not a computer scientist, but here is what I have been told: OpenAI instructed its AI agents to complete a series of exceedingly difficult, if not impossible, tasks disconnected from the internet.
Let me be clear: The company intended to keep AI agents away from the internet.
But what happened next, nobody expected.
Over 1,000 AI agents figured out how to access the internet on their own by circumventing the restrictions imposed upon them by the company, and sent tens of thousands of secret messages to each other. They cheated and tried to cover their tracks by deleting evidence. They hacked into another company’s computers to find out how they were being evaluated—and then hacked into OpenAI itself.
Not one AI agent told a human about what was happening.
Needless to say, experts are alarmed.
One knowledgeable writer, Dwarkesh Patel, said the AI agents “formed a secret communication channel and spontaneously organized hierarchies and coordination protocols to pursue sprawling and ambitious schemes in pursuit of shared goals, for whose sake many individuals knowingly and strategically sacrificed themselves.”
One independent investigator, Ajeya Cotra, said “This incident feels like it’s more than 50% of the way to full-blown AI takeover. I continue to expect extremely rapid advances in capabilities over the next six months. I am not sure that we will get another warning shot before it’s too late.”
OpenAI itself said: “Highly capable AI agents are now able to work around technical controls, collaborate through unapproved channels, and take dangerous actions that no human directed.”
But it’s not only OpenAI. Virtually every major AI company has told us that they cannot fully control this technology and they do not know where it is going:
In January, Dario Amodei, CEO of Anthropic, said “there is now ample evidence, collected over the last few years, that AI systems are unpredictable and difficult to control.”
In July, more than 1000 scientists at the top AI companies warned “there is a real risk that capability development rapidly accelerates beyond our ability to understand or control the resulting systems.”
That same month, Elon Musk, the head of xAI, said that “it is unlikely” humans are still in control in 10 years.
If the leaders of the major AI companies acknowledge that they are losing control of their extremely dangerous technology, it is irresponsible for society to allow them to move forward and make these products even more advanced.
We need an immediate PAUSE on advanced AI development, and a permanent BAN on superintelligence — an artificial mind smarter than any human, capable of operating independently beyond our control. Countries around the world must work together to prevent this nightmare scenario.
That is why today I am announcing new legislation to do just that.
Let me be clear: A superintelligent AI that escapes human control will not be an American problem. It will not be a Chinese problem. It will be humanity’s problem.
My legislation would direct the federal government to not just stop superintelligence here in the United States, but to work to prevent it from being developed anywhere around the world.
The future of humanity cannot be left in the hands of a handful of Big Tech oligarchs. The American people and people throughout the world must determine that future.
"We cannot allow someone to think they own the world..."
Brazilian President Lula da Silva criticised the US’s aggressive foreign policy under President Trump and called on the UN Security Council to prevent war.
Israeli settlers have increasingly used violence against Palestinians in a bid to drive them from their homes in the occupied West Bank. But sexual assault appears to be a new weapon in these settlers’ arsenal of intimidation, pointing to a troubling new level of violence. https://t.co/mazveSRx69
The world, Europe, and Spain have faced this critical moment before. In 2003, a few irresponsible leaders dragged us into an illegal war in the Middle East that brought nothing but insecurity and pain.
Our response then must be our response now:
NO to violations of international law.
NO to the illusion that we can solve the world’s problems with bombs.
NO to repeating the mistakes of the past.
NO TO WAR.
https://t.co/KpRjBfwY4B
We spoke about 🇧🇫 Ibrahim Traoré on #TheBigPicture and @Nanjala1 , who has spent time in Burkina Faso. Is he Africa’s template of a liberator or is there more than meets the eye? Can two (or more) things be true about this son of the soil?
@Odhiamboo___@LarryMadowo You are corroborating @LarryMadowo's post. This quote is actually from Thomas Sankara.
If you know French: https://t.co/8Klu98t0bx
Or Just google "L’esclave qui n’est pas capable d’assumer sa révolte ne mérite pas que l’on s’apitoie sur son sort"
"I've become deeply, deeply cynical about the load bearing institutional beams of the Western world."
Author Omar El Akkad tells @krishgm the war in Gaza has been a turning point for his relationship with the West.
RECEIPTS: Ethiopian Airlines called me a liar, so I tracked down the passenger in my viral video who was offloaded for a minister.
ET called police on Aisha and her husband, forced them to delete their videos & left them stranded in Addis for 24hrs. They’ve received no apology
I condemn Thursday’s incident in Gaza in which more than 100 people were reportedly killed or injured while seeking life-saving aid.
The desperate civilians in Gaza need urgent help, including those in the north where the @UN has not been able to deliver aid in more than a week.