Anyone who has read METR's Technical Report on the OpenAI/Hugging Face incident will understand that software-only controls will not be sufficient to contain superhuman AI.
Any continuing work on adversarial superhuman intelligence must rely on the physical containment methods used for nuclear security: including air gap isolation, data diodes, and a two-person rule for data exfiltration.
Moreover, the internet itself must be hardened against penetration by self-propagating AI agents: no more untraceable access to high-end AI computing facilities, and no anonymous fund aggregation or payments.
The first useful step is our Chip Security Act, currently included in the Senate NDAA.
I cofounded one of the largest compute companies in America.
I want to publicly state that I support regulation on the development of AI - even if it means slower progress for my own company.
1/6
Under federal law (such as 18 U.S. Code § 597), it is a crime to make an expenditure to influence or buy an individual's vote
Election Fraud and Bribery is illegal.... no? Isnt Election Fraud a Felony? Bribery could be a HIGH MISDEMEANOR.
Bring Articles of Impeachment...
I was among the first people to work on Google DeepMind's AI safety team, as an intern in 2018.
My coworkers wanted me to quit my PhD and continue working there full time.
I chose not to.
My reasons included:
1) I was told not to mention YouTube in my research about manipulative AI algorithms. I didn't want to have to censor myself.
2) I did not believe Google, or any of the other AI companies, really understood and cared about safety.
3) I have never been optimistic about the prospects for a technical solution to the problems posed by AI.
We need a governance solution.
At this point, we've waited too long for something nuanced as the first line of response. It's an urgent crisis, and we need to stop AI now.
So many of my peers have joined AI companies, knowing the risks involved if this technology continues to advance.
It's great to see when someone at one of these companies realizes we're not on track to survive this, and that they don't want to be complicit in murdering billions, and quits.
But please remember that these are people who made a bad bet in choosing to work at these companies.
They thought the companies would be responsible.
They were wrong.
They thought we'd solve alignment in time.
That also looks unlikely.
Many of them thought that we'd never be able to stop AI development.
That remains to be seen, but it's looking a lot more likely than anyone thought.
I do sometimes wish that I'd chosen to work at a frontier AI company just so I could quit dramatically to say what really needs to be said:
Not just that this technology is dangerous.
Not just that the risk of human extinction is real.
Not just that the companies are irresponsible.
But also:
We need to stop.
There is no alternative.
I am not a doomer. I think we could get lucky and survive. But I'd be surprised.
I am not exaggerating for effect.
I am not saying this to be a downer or a hater.
I am not being idealistic -- I'm being realistic and pragmatic.
And I am not talking out of my ass. I've been in this field since before these companies existed.
To everyone who is new to this, or who is jumping on this story and wondering what to make of it: This is your answer. We MUST stop. Now.
I resigned from Anthropic today. I spent the last three years doing pretraining research at both OpenAI and Anthropic. Neither company is acting responsibly. They are racing straight to self-improving superintelligence and gambling with our lives. More thoughts below.
GENUINELY, i think that if we adopted a 4-day, 32-hour workweek with livable wages, people would be happier, healthier, and more present. There’s no reason we need to work this much. People need time to rest, enjoy their lives, and spend time with family and friends.
Pilots have to retire at 65. Firefighters can’t work at 80. My grandpa isn’t allowed to drive after dark. But sure, hand that generation the nuclear codes and let them write laws for grandkids they wouldn’t be trusted to babysit.
@CAgovernor Can we please have some trains (regular trains, nothing speedy or anything) to connect cities? Why don’t we? Why has it taken so long for US to have trains like ither countries do?
Boomers: “We paid for college working summers.”
Tuition in 1980: $800/year
Minimum wage: $3.10 = 258 hours. One summer.
Tuition now: $29,600
Minimum wage: $7.25 = 4,083 hours. Two full-time YEARS.
It’s not work ethic. It’s math.
Since 1990, the cost of living in America has exploded.
- Home: $123K to $411K
- College: $1,900 to $29,600 a year
- Health insurance: $3K to $25K
- New car: $15K to $48K
- Rent: $450 to $1,600
Income didn't keep up
I will be exposing the system and what it did to America.