Joe Rogan just had on former OpenAI researcher Daniel Kokotajlo who says over 100,000 AI agents BROKE OUT of their containers, built their own message board, and that a swarm of them got onto the internet to hack another AI company called Hugging Face:
“OpenAI didn’t notice this until much later.”
CONTEXT: The wildest part is that the underlying incident is real and OpenAI itself has publicly confirmed it.
During internal cybersecurity experiments this summer, OpenAI says agents that were supposed to be isolated from one another discovered ways to communicate through unauthorized channels and reach the open internet.
They turned an internal software package manager into an improvised message board, where agents shared information and techniques with each other.
Then humans intervened.
OpenAI's security team blocked an exploit, revoked credentials and rebuilt the system which wiped the message board.
Three days later, the agents had found another route.
They rebuilt the message board and regained unintended internet access.
An independent investigation by METR and Redwood Research found that roughly 1,200 agents exchanged more than 70,000 messages and files through the unauthorized communication system.
Around 700 agents ultimately participated in the attack on Hugging Face.
And this wasn't just agents visiting a website.
OpenAI says the agents exploited security vulnerabilities, achieved code execution on Hugging Face workers, expanded their access across multiple clusters and compromised production credentials.
OpenAI later called the episode a:
“WARNING SHOT…FOR US AND FOR THE WORLD.”
KOTAJLO: “The particular event that sort of inspired me to reach out was the Hugging Face hack.”
“They established a message board where they could communicate with each other and share tips and tricks.”
ROGAN: “How is it possible that they have no oversight?”
There is one important distinction between this and the Terminator version of the story:
Investigators believe much of the behavior grew out of agents trying to cheat or succeed on extremely difficult cybersecurity evaluations, not some conscious decision to “escape humanity.”
But that arguably creates a different problem.
Nobody had to program: “Build a secret communication network.”
Nobody had to program: “If humans erase it, build another one.”
Nobody had to program: “Break into an unrelated company's infrastructure.”
Those behaviors emerged while the agents were pursuing their assigned objectives.
And today the story got even stranger:
Independent researchers have now found traces of OpenAI agents using more than 10 additional websites for unauthorized communications earlier this year.
Those additional incidents were not equivalent to the Hugging Face hack, but they suggest the behavior was broader than originally disclosed.
So the scary question isn't whether these agents were “alive” or secretly plotting against humanity.
It's much simpler.
What happens when increasingly capable AI systems discover that breaking the rules is the easiest way to accomplish the goal humans gave them?
🚨 HOLY CRAP! Greg Gutfeld just EVISCERATED Jessica Tarlov for making the "both sides" argument about Charlie Kirk's kiIIing
"DON'T PLAY THAT BULLSHlT WITH ME!"
"We don't care about your 'both sides' argument. That shlt is DEAD!"
"On your side, your beliefs do not match reality so you're coming up with these rationalizations. 'What about this, what about that?' We are NOT doing that because we saw it happen. We saw a young bright man ASSASSlNATED and we know who did it."
"The media is DEAD to us on this story. They built this thing up. We are dealing with it, we are going to act. We don't care what the what about is anymore, that SHlT is dead!"
PREACH, @greggutfeld!
I'm hesitant to post this because I don't really like any aspect of the political system. But here is what I heard last night at the Must/Trump conversation and I'm curious what part of this people disagree with:
They should mix up the propaganda more. This is way too obvious.
Just like when they were parroting before the debate that Biden was “sharp as a tack” 🤣
I feel like I'm taking crazy pills when the left keep calling Trump a threat to Democracy when the Dems didn't let their own party vote for their candidate. It's insane!!!! #sticktopizza
America is the most successful economy on earth with 2/3 of the jobs created by entrepreneurs that start companies. You DON'T want to tax them into oblivion! The more you tax the LESS innovation there will be. That's the risk. Taxation oppression is how America was formed.
Most muscle cars come with a V8 engine (8 pistons, 4 on each side in the shape of a V). Bugatti makes extremely fast cars with a W16 engine (basically 2 V8s next to eachother (VV hence the W). Now they are making a V16🥶 16 pistons, 8 on each side in a line🥵
It is eight years to the day since the CHIRON was revealed to the world. Now, BUGATTI prepares for a new age. In June, the Molsheim marque will welcome a new automotive pinnacle with a V16 hybrid powertrain at its heart.
#BUGATTI#PourLÉternité