@peterwildeford@PunchbowlNews interesting that both the labs (per axios) and congress now point at cyber as the first big one. might end up being AI's ozone hole
sam altman says society will have to accept "some fairly severe cyber incidents" from open models as the price of liberty.
we don't say that about planes, medicines or nuclear plants. we certify them first.
why is AI the exception?
Sam Altman says society will have to accept severe cyberattacks from open-source AI as the price of preserving freedom
"I support open source models. There is a coming tidal wave of cybersecurity problems that are going to come from these open source models"
"There are people in the industry who say we should ban open source, because otherwise a bunch of systems are going to be hacked"
"We're going to, as a society, I think, have to just accept some fairly severe cyber incidents from open models, in exchange for the liberty that comes with that"
@Miles_Brundage same thing happened to "AI safety". in 2023 it was literally the name of the summit, by 2025 vance opened his speech by saying he wasn’t there to talk about it
In july, 29 countries set up a new global AI cooperation body in Shanghai. The diplomat called it “china’s new AI club”.
AI governance is splitting into rival clubs. Will countries come to their senses in time and start working together instead of competing?
Axios is reporting that the top labs are wargaming scenarios for the aftermath of a catastrophic event in the next 6 - 12 months, that some executives now see as being inevitable.
@j_asminewang whatever actually happened, this is why labs need an independent process for safety disputes. right now it's just "trust us" vs "trust us"
@hamandcheese@deanwball@tylercowen ask him which existing institution he'd actually trust to handle advanced AI, given how worried he is about institutional decay
@ohlennart nuclear test bans got lucky here. the thing you can verify (a seismic signal) is almost the same thing that matters (a test). AI doesn't get that luxury
The treaty banning nuclear tests was signed in 1996 and still hasn't entered into force.
But its global monitoring network was built anyway, and it caught North Korea's nuclear tests.
With AI we keep waiting for the treaty. maybe the monitoring should come first.
@russianforces interesting that the push would have to come from the non-P5. feels like middle powers are the ones with the most reason to defend these norms now
The UN Security Council passed 44 resolutions in 2025. lowest since 1991.
at the same time there were 130+ active armed conflicts, the most since WWII.
The body built to stop wars is deciding less while there are more of them.