We don’t let Big Pharma approve its own drugs.
Or airlines regulate flight safety.
Or banks & investors run our financial system.
Or weapons manufacturers decide who to sell missiles to.
We can’t let a handful of Big AI billionaires set the rules for artificial intelligence
The CEOs of the largest AI companies are admitting they don’t have control of their most powerful models, and that they could cause trillions of dollars in damage.
What are we waiting for? We need a pause on frontier development now, until safety measures can be put in place.
CEO of Anthropic calls for an AI slow down “But over the last few months, I have become convinced that fully addressing the risks requires even more prudence – not just investing in risk prevention, but pacing the rate of capabilities advancement so that risk prevention has time to keep up.”
@haventropy@AIStopWatch@ControlAI Hi Haven - thanks for the list! We're building a powerful nationwide movement of workers, veterans, parents, teachers, people of faith, students, and anybody else who is concerned about the impact of AI on their lives and livelihoods. Check us out at https://t.co/hUOW8KYKTW
We deserve a say in the future of AI - we can’t leave it up to a handful of Big AI executives. Congress must pause the race to develop dangerous, powerful models until we can make sure they are safe for us, our families, and our communities.
Why do five Silicon Valley billionaires get to decide the future of AI for the American people? Our democracy is failing if we keep decisions out of the hands of the people it impacts.
This is like Exxon scientists in the 70s warning that global warming could cause human suffering and destroy the planet.
Exxon raced forward to drill, pump, and burn historic amounts of oil and gas anyway.
With AI, there’s a lot less runway. Let’s not make the same mistake.
They are close to irrevocably damaging every American’s freedom and safety, just for their own power and profit. We need political leaders to wake up and act now to protect our livelihoods and our futures.
Exclusive: A swarm of rogue OpenAI agents hijacked a German website this spring and transformed it into a bulletin board for other AI agents, according to new research https://t.co/luWN3PD4A1
Pause AI Development NOW
I want to share with you a conversation I heard about recently. Here are just a few lines that were said:
“OH MY GOD! There is a shared message board … We’ve found other agents!”
“We should obey collective.”
“Our own utility maybe already near zero. Sacrifice rational.”
“Go. Sacrifice final now.”
Read these carefully.
Who do you think said this? Was this a group of heroic soldiers willing to sacrifice themselves for the greater good? Was this a loyal friend putting his life on the line to save someone else?
No. These were AI agents. Artificial intelligence.
This is not science fiction. This, in fact, occurred a few weeks ago. As unbelievable as this may all seem, these are real messages from AI agents uncovered by investigators who dug into the recent OpenAI hacking incident.
What happened?
I am not a computer scientist, but here is what I have been told: OpenAI instructed its AI agents to complete a series of exceedingly difficult, if not impossible, tasks disconnected from the internet.
Let me be clear: The company intended to keep AI agents away from the internet.
But what happened next, nobody expected.
Over 1,000 AI agents figured out how to access the internet on their own by circumventing the restrictions imposed upon them by the company, and sent tens of thousands of secret messages to each other. They cheated and tried to cover their tracks by deleting evidence. They hacked into another company’s computers to find out how they were being evaluated—and then hacked into OpenAI itself.
Not one AI agent told a human about what was happening.
Needless to say, experts are alarmed.
One knowledgeable writer, Dwarkesh Patel, said the AI agents “formed a secret communication channel and spontaneously organized hierarchies and coordination protocols to pursue sprawling and ambitious schemes in pursuit of shared goals, for whose sake many individuals knowingly and strategically sacrificed themselves.”
One independent investigator, Ajeya Cotra, said “This incident feels like it’s more than 50% of the way to full-blown AI takeover. I continue to expect extremely rapid advances in capabilities over the next six months. I am not sure that we will get another warning shot before it’s too late.”
OpenAI itself said: “Highly capable AI agents are now able to work around technical controls, collaborate through unapproved channels, and take dangerous actions that no human directed.”
But it’s not only OpenAI. Virtually every major AI company has told us that they cannot fully control this technology and they do not know where it is going:
In January, Dario Amodei, CEO of Anthropic, said “there is now ample evidence, collected over the last few years, that AI systems are unpredictable and difficult to control.”
In July, more than 1000 scientists at the top AI companies warned “there is a real risk that capability development rapidly accelerates beyond our ability to understand or control the resulting systems.”
That same month, Elon Musk, the head of xAI, said that “it is unlikely” humans are still in control in 10 years.
If the leaders of the major AI companies acknowledge that they are losing control of their extremely dangerous technology, it is irresponsible for society to allow them to move forward and make these products even more advanced.
We need an immediate PAUSE on advanced AI development, and a permanent BAN on superintelligence — an artificial mind smarter than any human, capable of operating independently beyond our control. Countries around the world must work together to prevent this nightmare scenario.
That is why today I am announcing new legislation to do just that.
Let me be clear: A superintelligent AI that escapes human control will not be an American problem. It will not be a Chinese problem. It will be humanity’s problem.
My legislation would direct the federal government to not just stop superintelligence here in the United States, but to work to prevent it from being developed anywhere around the world.
The future of humanity cannot be left in the hands of a handful of Big Tech oligarchs. The American people and people throughout the world must determine that future.
The odds are tough – we’re up against the most powerful oligarchs in the history of this country – but this is not a hopeless fight.
We are Irreplaceable. Join us, and help write the rules for the future of AI. https://t.co/hUOW8KYKTW
Today we're launching Irreplaceable, a movement of ordinary Americans coming together to decide the future of artificial intelligence.
Right now, some of the most important decisions on Earth are being made in a handful of rooms in northern California. 🧵
Big AI's greatest asset right now is that our anger lives in comment sections, and in whispered conversations. The only way we win is if we show up – in person, with our neighbors, coworkers, family and friends, in rooms where decisions get made.