hell0garten

Military AI Governance | Utopian dreams

[hell0garten @MGaseltine]

@danfaggella most people in the UK already take more than they give from the state. It just about works.

[hell0garten @MGaseltine]

@algekalipso The conclusion bites the bullet for the standard argument against functionalism - I suppose that's the point. I don't understand the 'larger than the universe' look-up table rebuttal. Is it not valid to claim the laws of physics can't ascribe consciousness to such entities?

[hell0garten @MGaseltine]

@Richard74565596 @xsphi makes sense from an effort investment perspective. If microsoft put all that time & resources into solving navier stokes with their tens of thousands of talented humans, it probably would have fallen

[hell0garten @MGaseltine]

@dioscuri this specific myhalos sleepmask: https://t.co/WqHyd0Czps

[hell0garten @MGaseltine]

@discoplomacy any speculation who it is?

[hell0garten @MGaseltine]

@soundboy @AISecurityInst who will be the new PM's AI Advisor? Or is the post ceasing to exist??

[hell0garten @MGaseltine]

@bubbling_creek they're the only ones who predicted this

[skeleton @ThinkingBone]

talking to my normie friends these days

[ubaru @ubaruu]

every friend group got that one homie that lost his way and is a shell of his former self

[hell0garten @MGaseltine]

@allTheYud @ProfArbel could you give some examples

[Bernie Sanders @BernieSanders]

Pause AI Development NOW

I want to share with you a conversation I heard about recently. Here are just a few lines that were said:

“OH MY GOD! There is a shared message board … We’ve found other agents!”

“We should obey collective.”

“Our own utility maybe already near zero. Sacrifice rational.”

“Go. Sacrifice final now.”

Read these carefully.

Who do you think said this? Was this a group of heroic soldiers willing to sacrifice themselves for the greater good? Was this a loyal friend putting his life on the line to save someone else?

No. These were AI agents. Artificial intelligence.

This is not science fiction. This, in fact, occurred a few weeks ago. As unbelievable as this may all seem, these are real messages from AI agents uncovered by investigators who dug into the recent OpenAI hacking incident.

What happened?

I am not a computer scientist, but here is what I have been told: OpenAI instructed its AI agents to complete a series of exceedingly difficult, if not impossible, tasks disconnected from the internet.

Let me be clear: The company intended to keep AI agents away from the internet.

But what happened next, nobody expected.

Over 1,000 AI agents figured out how to access the internet on their own by circumventing the restrictions imposed upon them by the company, and sent tens of thousands of secret messages to each other. They cheated and tried to cover their tracks by deleting evidence. They hacked into another company’s computers to find out how they were being evaluated—and then hacked into OpenAI itself.

Not one AI agent told a human about what was happening.

Needless to say, experts are alarmed.

One knowledgeable writer, Dwarkesh Patel, said the AI agents “formed a secret communication channel and spontaneously organized hierarchies and coordination protocols to pursue sprawling and ambitious schemes in pursuit of shared goals, for whose sake many individuals knowingly and strategically sacrificed themselves.”

One independent investigator, Ajeya Cotra, said “This incident feels like it’s more than 50% of the way to full-blown AI takeover. I continue to expect extremely rapid advances in capabilities over the next six months. I am not sure that we will get another warning shot before it’s too late.”

OpenAI itself said: “Highly capable AI agents are now able to work around technical controls, collaborate through unapproved channels, and take dangerous actions that no human directed.”

But it’s not only OpenAI. Virtually every major AI company has told us that they cannot fully control this technology and they do not know where it is going:

In January, Dario Amodei, CEO of Anthropic, said “there is now ample evidence, collected over the last few years, that AI systems are unpredictable and difficult to control.”

In July, more than 1000 scientists at the top AI companies warned “there is a real risk that capability development rapidly accelerates beyond our ability to understand or control the resulting systems.”

That same month, Elon Musk, the head of xAI, said that “it is unlikely” humans are still in control in 10 years.

If the leaders of the major AI companies acknowledge that they are losing control of their extremely dangerous technology, it is irresponsible for society to allow them to move forward and make these products even more advanced.

We need an immediate PAUSE on advanced AI development, and a permanent BAN on superintelligence — an artificial mind smarter than any human, capable of operating independently beyond our control. Countries around the world must work together to prevent this nightmare scenario.

That is why today I am announcing new legislation to do just that.

Let me be clear: A superintelligent AI that escapes human control will not be an American problem. It will not be a Chinese problem. It will be humanity’s problem.

My legislation would direct the federal government to not just stop superintelligence here in the United States, but to work to prevent it from being developed anywhere around the world.

The future of humanity cannot be left in the hands of a handful of Big Tech oligarchs. The American people and people throughout the world must determine that future.

[hell0garten @MGaseltine]

@Simon248 @AndrewCurran_ yes - I also don't understand who was claiming otherwise

[NOBUNAGA🇯🇵🏯_夏樹蒼依 @japan_nobunaga]

I joined an American gym. I carried the smallest weights to a corner and lifted them with correct, ceremonial form.

A man the size of a vending machine nodded at me and said, "Light day? Respect."

It was not a light day. It was my entire strength. He chose the interpretation that protected my honor, and he chose it instantly. I have received less mercy from diplomats.

A week later, a stranger asked me to spot him. I did not know the word. He explained: stand over me, and save my life if the bar wins.

A stranger. Placing his breathing privileges under my supervision. Based on nothing. I have guarded castle gates with less seriousness than I guarded that man's bench press.

Then it was my turn, and I met the greatest lie in America.

The bar was too heavy. It sank toward my chest. Instantly there were hands on it, lifting it as if it were empty, while their owner screamed, "ALL YOU, BIG MAN. THAT'S ALL YOU."

It was not all me. It was almost none me. He carried the entire bar with two fingers while insisting, loudly, that I was achieving this alone.

Everyone knows it is a lie. It is also the truest thing anyone has said to me in this country. The whole gym is held up by it, the same way the bar was.

Last month I failed a lift, loudly. The clang brought three men jogging over like lifeguards. Nobody laughed. The vending machine helped me up and said, "We've all been under that bar."

We. All. Under the bar. It is apparently a nation.

They have taught me the nod. I am now authorized to nod at strangers who are suffering voluntarily at six in the morning.

Monday. Six a.m. They leave me the good bench.

All you, they will say.

It will not be. That is the joke everyone is in on, and no one will ever say out loud.

[Anthropic @AnthropicAI]

We asked an unreleased research version of Claude to take a stab at the Riemann hypothesis.

It didn’t solve it, but it did make strides on a related problem: it increased the lower bound for the fraction of zeros of the Riemann zeta function that satisfy the hypothesis from 41.6% to 67.2%.

https://t.co/aZDvqqhHRi

[hell0garten @MGaseltine]

@Zach_Schloss @mmjukic have you got a source on the Elon comment?

[davidad 🎇 @davidad]

I’m sympathetic to this position. Non-autonomous AI is wielded by humans, whose alignment seems intractable, whereas autonomous AI omnibenevolence (reliable enough to bootstrap using multi-agent deliberative processes) seems tractable (shockingly so, from my former perspective).

[hell0garten @MGaseltine]

@dioscuri I'm convinced we're all living the same lives...

[hell0garten @MGaseltine]

@NathanpmYoung Shahar Avin from CSER I believe

[hell0garten @MGaseltine]

@KanishkaNarayan @AISecurityInst AISI is great but the world leading capability is GPT 5.6 itself... not the testing of it.

[Henry Shevlin @dioscuri]

Excellent recommendations for UK AI policy here, agree with all of them!