Michaël Trazzi

[Michaël Trazzi @MichaelTrazzi]

I organized the biggest AI Safety protest in US History!

Nearly 200 people marched from Anthropic to OpenAI to xAI with one demand: commit to pausing if the others do too

[Michaël Trazzi @MichaelTrazzi]

Sure, they claim to be working on the verification regime, and say they'll organize conversations around full recursive self-improvement (RSI) and coordination

But when a ~$1T company actively working towards RSI files for IPO, I think we need much more than just "conversations"

[Michaël Trazzi @MichaelTrazzi]

Anthropic expects it 'would slow down or temporarily pause' if other developers at or near the frontier verifiably did too.

This is a good first step, but what we really need is a binding commitment from Dario Amodei, and the actual verification regime that would satisfy them

[Michaël Trazzi @MichaelTrazzi]

Anthropic co-founder Jack Clark would be in favor of "elegantly" slowing down AI development to avoid the development of a powerful technology at "breakneck speed"

[Michaël Trazzi @MichaelTrazzi]

This was just the first hour and a half of the trial, that is currently restarting at 1:30pm at the superior court of california, room 503.

This trial will be happening this week and could run until June 17.

Hearing a judge talk about existential risk from AI (instead of dismissing it completely like in Musk v. Altman) felt like the start of a new chapter of history.

I highly recommend people coming to watch the trial, which will involve high-profile expert testimonies, including potentially Max Tegmark (@tegmark) and Stuart Russell.

Case number: CRI-25404422 (6/6)

[Michaël Trazzi @MichaelTrazzi]

This morning I witnessed the first US criminal trial on existential risk from AI.

Surprisingly, the judge did NOT initially dismiss Wynd Kaufmyn's necessity defense arguments for blocking the doors of OpenAI, to prevent an existential threat. The judge wants to hear more (1/) 🧵

[Michaël Trazzi @MichaelTrazzi]

Another point of contention has been the nb of doors that the OpenAI building had at the time.

By law, depending on the square footage, OpenAI would have been required to have two doors for fire hazard reasons. So employees would then still have been able to come in and out (5/)

[Michaël Trazzi @MichaelTrazzi]

I went live with @AliVelshi on @MSNOWNews (formerly @MSNBC) to discuss Stop The AI Race and humanity's path to an international treaty on AI

[Michaël Trazzi @MichaelTrazzi]

My statement regarding pope's encyclical

[Michaël Trazzi @MichaelTrazzi]

Stop The AI Race featured in ABC, one of Spain's major newspapers

[Michaël Trazzi @MichaelTrazzi]

@jackclarkSF At what point will Anthropic pause automation of AI R&D / recursive self-improvement R&D, so that it can focus on making sure RSI doesn't lead to catastropic outcomes, including human extinction? Would Anthropic pause frontier AI development if China & other labs also did?

[Michaël Trazzi @MichaelTrazzi]

The judge from Musk v. Altman instructed Musk to not talk about extinction again

[Michaël Trazzi @MichaelTrazzi]

Google is apparently keeping their best coding model secret to focus on accelerating AI R&D internally

Only Anthropic can access Claude Mythos to automate AI research

This is not how humanity wakes up to the dangers of recursive self-improvement.

This suicide race has to stop.

[Michaël Trazzi @MichaelTrazzi]

Following our March 21st Stop The AI Race protest, Sam Altman agrees that pausing AI development may be necessary in the future

"We expect there will be periods where we need to collaborate with governments, international agencies, and other AGI efforts to ensure that we have sufficiently solved serious alignment, safety, or societal problems before proceeding further with our work."

[Sam Altman @sama]

Our Principles:

Democratization, Empowerment, Universal Prosperity, Resilience, and Adaptability

https://t.co/g58WGndARw

[Michaël Trazzi @MichaelTrazzi]

@imjmcinnis There you go

https://t.co/Uaw5RHMzcR

[Michaël Trazzi @MichaelTrazzi]

In The Washington Post this morning

[Michaël Trazzi @MichaelTrazzi]

In-depth coverage of AI Safety Activism on NBC News

[Michaël Trazzi @MichaelTrazzi]

Met with @tedlieu's office in DC.

He breaks AI risk into three buckets: AI we're not worried about, AI that could hurt people, and AI that could kill everyone.

He signed the 2023 CAIS statement and I've been impressed by how seriously his office takes AI's extinction threat.