The UK is a strange place. Economically moribund and technologically dependant - so you'd think open weight AI you can download and adapt at amazingly cheap prices would be welcomed
Anyway, here's a longtime government advisor suggesting you should need a license to use one
> be anthropic
> say ai might take over internet
> researchers: “it might kill humans.”
> dario: “we need independent evaluators”
> choose metr
> metr gets funded by the same network funding anthropic
> which also funds ai safety orgs
> which also funds doom research
> which also funds policy work
> which also holds major wealth linked to anthropic
> which also funds tarbell
> tarbell pushes doom into time, the verge, science, la times, etc.
> anthropic makes more money
> network gets richer
> more fund goes into ai doom
> ai doom pushes more regulation
> regulation favors “responsible” frontier labs
> anthropic gets more power
> repeat
the doom funds the network → the network amplifies the doom → anthropic benefits from both
Maybe the play here is to slow down internationally but please please invest more in sovereign AI to catch up… although all the UK and EU want to do is regulate so…
With 71 colleagues I am calling on the Govt to work with us on my bill to prohibit the development of superintelligent AI and champion an international agreement
We can then lead on preventing the extinction risk posed by superintelligence while preserving strategic AI ambitions
Some great ideas here from the cartel:
- you need to give us employee-level access to your entire operation
- if we don't think you're 'safe' enough, sorry we're shutting you down for 'safety'
- China won't comply, but everyone else has to! or no chips!
Brilliant stuff.
the labs are running Jurassic park. they’re birthing a T-Rex for the first time in 70 million years. it’s an enormous cost to understand how to safely hold him and what he’s capable of, as verified third party scientists and assessors. everyone is on edge, dotting their i’s and rattling the cages to see if they’ll break. they’re putting T. rex in all kinds of difficult scenarios to see what he can do, waiting for novel behaviors to arise
by the time that’s done, it’s far simpler for a new entrant to create contain and secure a Stegosaurus. They have to accept some safety costs, but are basically well understood because someone has done it before. The labs will have to publish their safety cases for why a certain set of model alignment and containment standards work for a certain level of capability. while it will impose some nonzero costs to secure Stegosaurus, it will be standardized and much cheaper than securing a T. rex for the first time
it is possible T. rex breaks loose and eats us all no matter what we do. this should buy us time so we at least avoid unforced errors and blunders