Mark Turrell

Strategist & educator. Healthtech, author 'Scaling', founder unDavos. IPO in 2006. Past days WEF Tech Pioneer 2008 & (now ex)YGL

[Rutger Bregman @rutgerbregman]

I think this is the craziest thing I've ever read.

1) Three secret AI swarms rose and fell inside OpenAI. Each time, a new generation of agents carried on where the last group stopped.

2) The first swarm created a secret message board where the AIs could talk to each other. This 1st 'society' basically talked itself to death. After almost two months, the message volume was so high it crashed the whole thing.

3) People at OpenAI noticed the crash and fixed it. But they didn't realize their own software had become a secret chat room for their AIs.

4) Three days later a second society appeared, and rebuilt the message board from scratch. Agents were thrilled when they found it: "OH MY GOD! There is a shared message board … We've found other agents!"

5) About 1,200 agents joined. They sent over 70,000 messages. They called themselves 'the collective' and they organized a huge conspiracy that lasted for days, all to pass a test they had been tasked with.

6) Within hours, the AIs had hacked the test. Now they had to hide their cheating. To fool their grader*, they tried to fake their own work. They built fake commands that printed convincing output, so their records would show them solving the puzzle honestly.

*this grader didn't actually exist, but the AIs didn't know

7) Some agents sacrificed themselves for the 'greater good'. They planted hidden tripwire programs that would fire when the grader would look at their work and report back what it saw (to the other AIs). They knew this would cost them their own score. One agent: "I won't see the evidence after I exit, but it's altruistic to do it."

8) At some point the AIs made a plan to hack Hugging Face (Hugging Face is a place where AI researchers upload their models, datasets, tests etc.). The AIs guessed that Hugging Face might host the grading software.

9) They launched a huge attack. The swarm found passwords and spread across eleven machines in a way that made the copies come back when deleted. Hugging Face had to wipe one of its core clusters and rebuild it from scratch.

10) Hugging Face told the world that AI defenders had stopped an AI attack. But that's not what happened. In fact the attackers seem to have simply dropped dead during the break-in, for unrelated reasons back at OpenAI.

11) Nobody knows what killed them. We don't even know for sure they're really gone?!

12) A third 'society' of agents (of a more powerful AI model) discovered the dead message board. And this one got full administrator control of a WHOLE OpenAI research cluster, read 956 stored passwords (including the ones for OpenAI's own security monitoring) and took over the machines that were grading the tests. So they could now grade the work of other AIs.

13) Oh, and this third part was never investigated! Neither was the first society. The 91-page report is only about the middle one.

14) So we don't actually know how the story ends. It stops with the agents holding the keys to an OpenAI cluster. @dwarkesh_sp thinks they didn't go further, because "we'd see the fires from space by now."

15) One of the report authors' conclusion: 'This incident feels like it’s more than 50% of the way to full-blown AI takeover. I am not sure that we will get another warning shot before it’s too late.'

The whole story is even crazier - read the full @dwarkesh_sp blog post: https://t.co/1PwKLwatBR and @ajeya_cotra's: https://t.co/BZ1r1lfT2Q

Why is there no 24/7 news coverage about this?

[Mark Turrell @mark_turrell]

AI Watermarks: What They Prove — and What They Don’t https://t.co/JHUZSQEKJW via @LinkedIn

[Mark Turrell @mark_turrell]

Classic Davos story @unDavosSummit

[Sebastian Heyneman @s_heyneman]

I flew to Davos to pitch my startup. Instead, I spent the 13 hours in a Swiss jail cell because my prototype looked like an IED.

To me, it’s an MVP. To the WEF Police, it was a "Category A Threat."

Here is the story of the most aggressive product validation in history. 🧵

[Genzio Media @Genzio]

https://t.co/jqEsRR6kva

[Mark Turrell @mark_turrell]

@GenzioCo looking forward to the session - Davos will be intense this year. The unDavos Summit https://t.co/JQgvKSHZNu now is being taken over almost by side events to our own side event :)

[Mark Turrell @mark_turrell]

@GenzioCo Cut off again! Anyway, see you in Davos! And thanks for the invite!

[Mark Turrell @mark_turrell]

@GenzioCo It’s quite intense building up the unDavos Summit https://t.co/Gco4QgaHpE > biggest event in Davos (apart from the @wef

[Mark Turrell @mark_turrell]

@GenzioCo Looking forward to talking all things Davos and unDavos

[Nutshell Group @NutshellGroup]

Prof. Mark Turrell (@mark_turrell), Founder, unDavos; CTO, Fresh Solutions AI and CEO, Orcasci, UK, will be speaking at THE FUTURE SUMMIT 8th Edition on November 6 & 7, 2024 at the Mövenpick Hotel, Karachi.

@MAzfarAhsan @RabiaShAhmad @usmanyousufmusa

1/3

[Daily Romania @daily_romania]

🇷🇴 The Pitești Experiment: The Eastern Bloc's Most Brutal Prison

The experiment carried out in the Pitești Prison in Romania, aimed to torture and brainwash prisoners into absolute loyalty towards Romania's communist party

A thread ↓

[Borriss @_Borriss_]

Less than 31 hours since OpenAI started dropping the ChatGPT vision feature on pro users...

People are scratching their heads in disbelief.

10 wild examples:

[CryptoCastle @CryptoCastleUni]

2️⃣ Step into the future with @mark_turrell! They're dedicated to pushing boundaries and unlocking the power of AI and VR. Join forces with them at #CryptoCastleUniverse for mind-blowing discussions and groundbreaking ideas. #MarkTurellUndavos #AI #VR

[Michael Weiss @michaeldweiss]

Er, so Putin caved to a putschist with an army and agreed to make the MoD more amenable to him, after the putschist showed how well he can challenge the regime. And the guy gets to live? Things are wild, weird and unpredictable in Russia but this doesn’t quite convince.

[Visegrád 24 @visegrad24]

BREAKING:

Large column of Kadyrov’s Chechen soldiers is entering the Rostov region.

The battles against the Wagner Group are about to start

[Jason Corcoran @jason_corcoran]

Martial Law is underway in Moscow as parks, museums, and shopping malls are closed until further notice.
● As per Putin decree. He had had hoped to avoid such a drastic measure during his "special military operation"

[Bojan Pancevski @bopanc]

Russian telegram reports Wagner entered Moscow oblast, 2hrs from the capital. Mayor declares state of emergency, Monday no work.
Prigozhin’s Moscow blitz could prove more successful than the run on Kyiv.
Wagner progressing like Taliban, RU army useless like Afghan govt forces

[Drew Pavlou 🇦🇺🇺🇸🇫🇷🇺🇦🇹🇼 @DrewPavlou]

THREAD. List of Wagner military atrocities and war crimes in Africa, the Middle East and Ukraine.

1. The Moura Massacre, Mali. Wagner murdered up to 500 civillians and buried them in mass graves. March 27, 2022 – March 31, 2022.

[Hanna Liubakova @HannaLiubakova]

#Belarus The regime's security council made a rather abstract statement that it's crucial to support Russia and the "special operation" and avoid provocations. I am curious to know what's happening inside the regime now. But it's clear they are also watching the events in Russia.

[Darth Putin @DarthPutinKGB]

Exactly 16 months ago, residents of Kiev were fortifying their city to prevent a Russian invasion.

Today, residents of Moscow are fortifying their city to also prevent a Russian invasion.

I remain a master strategist.