.@paulfchristiano thinks that on the current trajectory (absent any slowing down), there is a 1 in 3 chance that we could have superintelligence powerful enough to overthrow the government within a year. (He articulates a concrete scenario).
He argues that the labs should pause further algorithmic progress until they can secure their weights and research secrets. Otherwise China could simply steal the superintelligence in the middle of the intelligence explosion, and the labs would no longer be able to slow down even if they saw their models going off the rails.
He also explains how AIs will be trained during the intelligence explosion, and why even a system trained entirely inside a data center could still have the capabilities profile such that humans would have very little chance of competing with it or controlling it.
And he discusses the plan for alignment - basically, making a superintelligence that actually does what we ask the way we mean it. Fixing reward hacks and building better graders will help up till the next few model generations, but he thinks that no single current approach has better than even odds of letting us control superintelligence. The hope is that the AIs figure out the solution to this problem during the intelligence explosion.
Paul is head of the Alignment Research Center. Previously, he was head of AI safety at the US AI Safety Institute. Before that, he led alignment at OpenAI, where he invented RLHF. He’s recently joined OpenAI’s board (though here he is speaking as a private citizen).
In good company with @TheStalwart, Adam Garfinkle, @default_friend and Walter Ong.
Great essay on literacy and digital orality by @EricLevitz
https://t.co/S1jc15ugD6
In 2022, Norway increased their wealth tax to 1.1%. Some billionaires moved out of the country. According to a viral claim, this resulted in a loss of revenue. Is this true? No. Over the next two years, wealth tax revenue soared to all time highs.. #bbcqt
This is so f*cked. If someone kept a dog or cat like this for even a few hours people would lose their minds. Yet this law would force these animals live like this for YEARS. Unimaginable evil.
"Americans are being buried under an avalanche of misinformation and disinformation, enabling the abuse of power. The free press is crumbling … Social media is giving up on fact-checking. The truth is smothered by lies told for power and for profit."
THREAD:
1. PERSONAL NEWS:
Today BBC News has announced plans to close @BBCHARDtalk after 3 decades holding the world’s politicians and powerbrokers to account. This is sad news for me personally, but much more important, I think it’s depressing news for the BBC🧵
Bought by my parents (fireman and teacher) for £116K in 1997. The current owner sold it in July for £765K.
Since 1997, the house price to wage ratio has rocketed. No amount of “life style adjustment” can hide this erosion of the lower middle class - see attached graph.
"The truth is, it’s getting harder to describe the extent to which a meaningful percentage of Americans have dissociated from reality. "
Read this great @cwarzel to get a sense of just how bad things have gotten
https://t.co/k63aUXZnTk
Why are humans so self-destructive? 'Nexus' argues that the fault is not with our nature, but with our information.
Out Sept 10: https://t.co/EeW9WvcbjQ.
#NexusBook#AI
Some of you (I hope) will be pleased to know there’s a second series of Call Jonathan Pie in the works for next Spring. Along with two US Election Specials before then!
In the meantime, you can binge on the first series here:
https://t.co/Xq6cOITdGU
In the aftermath of one of Gaza’s bloodiest days, when Israel killed 700 Palestinians in 24 hours, UNICEF said it’s trying to bring aid to Gaza but can’t because of the relentless bombing.
Here’s the play where Packers’ Luke Musgrave lacerates his kidney.
He would go onto play 16 more snaps, catch a pass, get tackled, and make multiple key blocks.
NFL players are maniacs.
These journalists are incredible. They literally are the world’s eyes in #Gaza right now and they’re being deliberately targeted. They’re mothers, daughters and sisters - just trying to stay alive to tell us what’s going on inside @IMSforfreemedia