Cyrus 🌎

Accelerating AI Safety
Stability AI & TFS

[Cyrus 🌎 @CyrusHodes]

To clarify:
- frontier AI companies clearly state they are building AGI
- from general to super intelligence (aka intelligence explosion), there is an unknown period (prob fast)
- controlling an ASI is virtually impossible
- why isn't this top of the global discourse?

[Tsarathustra @tsarnick]

Nobel Laureate Geoffrey Hinton says AI superintelligence is "not hype" and he used to think it was further away but the speed of recent developments have convinced him that it will happen in 5-20 years

[Cyrus 🌎 @CyrusHodes]

@bradrcarson 1. Glad the administration is embracing Pope Leo's recommendations 🙌
2. Loved the graduating cadets applauding to the human-in-the-loop part, echoing the other speeches Vance referred to (Eric Schmidt's most notably)👏👏

[Cyrus 🌎 @CyrusHodes]

@MarkBeall @danfaggella convergence...

[Tristan Harris @tristanharris]

Important AI redline being crossed with new hacking x self-replication research from @PalisadeAI — stemming from significant increases in both of these AI capabilities over the last year.

This is the kind of evidence, along with recent evidence of Mythos-level hacking, peer-preservation, AI’s autonomously mining crypto, etc that should be informing the AI agenda of the US-China Summit happening over the next two days. See below ⬇️

[Cyrus 🌎 @CyrusHodes]

💯

[Max Tegmark @tegmark]

If @realDonaldTrump & Xi can pull off a deal that keeps humans in charge of machines for the long haul, it deserves a Nobel Peace Price. 🏆

[Cyrus 🌎 @CyrusHodes]

@StephaneMallard Watch this new documentary @StephaneMallard https://t.co/GN7fe7OECA

[Paul Triolo @pstAsiatech]

Huge...
CAISI Signs Agreements Regarding Frontier AI National Security Testing With Google DeepMind, Microsoft and xAI
Expanded collaborations with leading U.S. AI labs provide for pre-deployment evaluations and other research.
https://t.co/cLXdQA9yk9

[Nate Soares ⏹️ @So8res]

I've been asked a few times for my take on how the White House is considering reviewing AI models "like an FDA drug" before release. My main take is: When people start to recognize the dangers, policy stances can turn on a dime. There's hope.

[Cyrus 🌎 @CyrusHodes]

@deanwball Thanks for your service @deanwball, voices of reasons, bipartisanship and a bilateral agreement with China on preventing catastrophic risks are all needed!

[Cyrus 🌎 @CyrusHodes]

Nice start. It would be great now for the Institute to start leading the global discussion on AI and defence beyond LAWS, beyond C4ISR, beyond selecting targets, toward the larger, unspoken threat to national security which is Loss of Control and Misalignment of powerful general purpose AI systems. Just saying @chipmanj ...

[Cyrus 🌎 @CyrusHodes]

@lawfare @ARozenshtein @Christophkw @thefuturesoc #athensroundtable

[Martin van Nostrand @martinvannost]

@axios The new models…

[Acyn @Acyn]

Khanna: They’re saying this technology is going to be bigger than nuclear, bigger than electricity, bigger than aviation.

Last I checked, we have an FAA for aviation, nuclear energy is regulated, and electricity is regulated. 

So you’re telling me on one hand that this is going to be bigger, and then you’re saying you don’t want any regulation. I mean, it makes no sense.

[Ricardo @Ric_RTP]

The CEO of Google DeepMind just admitted that if the decision had been his, we would've cured cancer before anyone ever used ChatGPT.

And that's not even the scariest thing he said on a recent interview.

Demis Hassabis is one of the most important people alive in AI.

He won the Nobel Prize last year for AlphaFold, the system that cracked the 50 year protein folding problem. 3 million scientists now use his tool. Almost every new drug being developed will touch it at some stage.

In a new interview, he was asked about the moment ChatGPT launched and Google went into "code red." His answer was one of the most revealing things any AI leader has ever said on the record:

"If I'd had my way, I would have left AI in the lab for longer. Done more things like AlphaFold. Maybe cured cancer or something like that."

Read that again.

The man running Google's entire AI division is publicly saying the commercial AI race we're all living through was a MISTAKE. That the industry got hijacked by a chatbot when it could have been solving the biggest problems in science and medicine.

His vision was simple:

Build AI slowly, carefully, like CERN. Use it to crack root node problems one at a time. Cancer. Energy. New materials.

Let humanity benefit from real breakthroughs while the foundational science was figured out over a decade or two.

Then ChatGPT dropped in November 2022 and everything changed.

Demis described what happened next as getting locked into a "ferocious commercial pressure race" that none of the labs can escape from. On top of that, the US vs China dynamic added geopolitical pressure.

The result is everyone sprinting toward products instead of breakthroughs, shipping chatbots while the scientific opportunity gets buried under marketing cycles and quarterly earnings.

But he's not saying progress isn't happening...

He's saying the progress got redirected away from the things that actually matter most.

And then it got even scarier:

Because when Demis was asked what he worries about with AI, he laid out two threats.

The first is what everyone talks about: Bad actors using AI for harm. Terrorist groups. Hostile nation states. Cyberattacks at scale.

But that's not the threat he's most worried about.

His second worry is AI itself going rogue. Not today's models. The models coming in the next two to four years as the industry enters what he calls "the agentic era."

Systems that can complete entire tasks autonomously. Systems that are increasingly capable and increasingly hard to control.

His exact words:

"How do we make sure the guardrails are put in place so they do exactly what they've been told to do, and there's no way of them circumventing that or accidentally breaching those guardrails? That's going to be an incredibly hard technical challenge if you think about how powerful and smart and capable these systems eventually get."

A Nobel Prize winner who runs one of the 3 most advanced AI labs on Earth just said publicly that within two to four years, we're entering a phase where AI alignment becomes a real problem, and the technical challenge of solving it is enormous.

And almost nobody is paying enough attention.

He called for international cooperation between labs, AI safety institutes, and academia to tackle the problem. He said this is the thing even the experts aren't thinking about enough.

He said the only way to get through the AGI moment safely is if everyone starts treating this with the seriousness it deserves.

Most AI CEOs give you careful PR answers about "responsible development" and move on.

Demis said something different...

He said the commercial race FORCED us into a premature deployment of a technology we barely understand, and the window to get alignment right before the next generation of agents shows up is two to four years.

If the man who built the system that might cure cancer is telling you he wishes it had happened first, maybe we should listen to what he says is coming next.

[Cyrus 🌎 @CyrusHodes]

1000%

[Dr. Roman Yampolskiy @romanyam]

*Nobody will ever be "in charge" of superintelligence.

[Cyrus 🌎 @CyrusHodes]

💯 @romanyam ! AI risks management is a national security issue and a network of autonomous agents should be regulated and monitored as critical infrastructure. And now that Moltbook is acquired by Meta (racing to build an uncontrollable Superintelligence), what could go wrong?...🙈

[Dr. Roman Yampolskiy @romanyam]

https://t.co/F4HCSXebQ2

[Future of Life Institute @FLI_org]

‼️New polling from @AIpolicynetwork finds that American voters overwhelmingly would prefer guardrails on AI over any other option - and would rather ban AI outright than proceed without regulation.

📢 Lawmakers, are you listening?

[Max Tegmark @tegmark]

We're excited to launch the Pro-Human AI Declaration, laying out a more inspiring AI path than Silicon Valley's dystopian race-to-replace. It has remarkably broad support, from Bannon to Bengio, from unions to faith groups, from parents to NatSec leaders. Please join our growing movement and let's make a difference!
(Links below in replies)

[CNBC-TV18 @CNBCTV18News]

The India AI Impact Summit goes live- and so do we.
Welcome to the CNBC-TV18 Edge AI Studio, presented by Qualcomm.

Broadcasting directly from the summit venue, CNBC-TV18 leads from the front! The first channel to go live from a specially crafted studio !

Watch: https://t.co/Ztc5DjJydj

#AI #CNBCTV18Digital #IndiaAIImpactSummit2026 #SafeAI #CNBCTV18 #AIGovernance

[Cyrus 🌎 @CyrusHodes]

"Outsmarting Ourselves? Risks and Rewards of the AI Race"
Thanks for putting this panel together and for having @Yoshua_Bengio setting the scene!🙏Together with @hlntnr and Madam Fu Ying.
Nice move @MunSecConf 👏👏

[Munich Security Conference @MunSecConf]

📣 OUT NOW: Agenda MSC 2026
https://t.co/aYHMrskJbz

[Cyrus 🌎 @CyrusHodes]

Disappointed that your report missed the opportunity to address AGI and national security risks. While all the labs are racing toward building superintelligence. Loss of Control and Misalignment should be on top of the discussions at MSC. It's time for the AI and defense discussions to go beyond LAWS... Hopefully next year