Dario has written that we need to “pace the frontier,” and Sam has agreed. People may be surprised by my response: go ahead.
You guys are the frontier. By any reasonable metric — market share, revenue growth, model capability — the two of you have a duopoly on frontier intelligence. You’ve also claimed the lead is widening because of recursive self-improvement.
I don’t see what you see in the lab. If the unreleased models are scary enough that you think you should slow down, I support your decision to be responsible.
But stop pretending you need anyone else’s permission. Stop pretending antitrust law has to be suspended so you can form a cartel. Stop pretending you need a regulatory approval process that supersedes product liability. Stop pretending METR is independent when it is intertwined with Anthropic’s investors and staff. Stop pretending you need those same evaluators to police competitors who aren’t even at the frontier.
Most of all, stop pretending the motivation to slow down is purely altruistic. You face massive product-liability exposure if your products enable a truly damaging cyberattack. The market already punishes models that behave in unpredictable or unauthorized ways. After the Hugging Face episode, it is simply good business for OpenAI and Anthropic to trade some raw power for reliability and predictability. Call it alignment if you want. It is also just giving customers what they want.
Pacing the frontier would also create breathing room for a more intelligent conversation about regulation than Bernie Sanders’ “shut it all down.” China is very unlikely to join a global agreement, as you know, and that has to be taken into account as well.
So go ahead and pace the frontier. You are the ones setting it. The easiest way not to build superintelligence is for you to agree not to build it. Demanding your preferred regulatory framework as the price of that will look like blackmail of the public and the political system. So just do it.
If you do, you’ll buy goodwill for the next conversation. If you don’t, we’ll know this was just another bid for regulatory capture — or an election-season psyop.
What Is To Be Done?
I propose a simple plan:
Big AI companies should be allowed to build AI as fast and aggressively as they can – but not allowed to achieve regulatory capture, not allowed to establish a government-protect cartel that is insulated from market competition due to incorrect claims of AI risk. This will maximize the technological and societal payoff from the amazing capabilities of these companies, which are jewels of modern capitalism.
Startup AI companies should be allowed to build AI as fast and aggressively as they can. They should neither confront government-granted protection of big companies, nor should they receive government assistance. They should simply be allowed to compete. If and as startups don’t succeed, their presence in the market will also continuously motivate big companies to be their best – our economies and societies win either way.
Open source AI should be allowed to freely proliferate and compete with both big AI companies and startups. There should be no regulatory barriers to open source whatsoever. Even when open source does not beat companies, its widespread availability is a boon to students all over the world who want to learn how to build and use AI to become part of the technological future, and will ensure that AI is available to everyone who can benefit from it no matter who they are or how much money they have.
To offset the risk of bad people doing bad things with AI, governments working in partnership with the private sector should vigorously engage in each area of potential risk to use AI to maximize society’s defensive capabilities. This shouldn’t be limited to AI-enabled risks but also more general problems such as malnutrition, disease, and climate. AI can be an incredibly powerful tool for solving problems, and we should embrace it as such.
To prevent the risk of China achieving global AI dominance, we should use the full power of our private sector, our scientific establishment, and our governments in concert to drive American and Western AI to absolute global dominance, including ultimately inside China itself. We win, they lose.
And that is how we use AI to save the world.
It’s time to build.
Very interesting thread from a computer security expert.
He says:
1. Building something that works in the real world is harder than what most armchair AI safety folks think.
2. there is a natural tendency to exaggerate the potential risks of your own work, because it makes you feel powerful and important.
🤖📈 Autonomous Agents Are The Fastest Growing Open-Source Technology In History
- But... what are autonomous agents?
- How do they work?
- How can you build or use one?
I wrote you the best overview on the planet.
Get ready for your mind to explode 🤯
https://t.co/YUrrlzGthO
QUICK SUMMARY OF THE STARSHIP TWITTER SPACE BY ELON MUSK.
(April 16, 2023) Starbase, Texas
“Set your expectations low.” - Elon Musk
Elon explained that If the idea of success is going to orbit it most likely will not happen. But if success is gathering data, that will definitely happen.
Elon said he spoke with the SpaceX Starship team and they can’t think of anything else that needs to be done. The ship is ready for a launch, and he still fully expects it not to happen. Most likely something will come up and it will be delayed. (Remember he has predicted Starship launch will be on April 20)
SOVIET N1 ROCKET
At least three times during the Twitter Space, Elon Musk recommended for anyone interested in big powerful rockets and the low chance of making it to orbit to learn about the Soviet N1 Rocket (largest rocket to date to attempt to get to orbit), it was the biggest explosion ever.
– Each of the four attempts to launch an N1 failed, with the second attempt resulting in the vehicle crashing back onto its launch pad shortly after liftoff.
BECOMING MULTI-PLANETARY
Elon made time to talk about the SpaceX Mission to make it to Moon and Mars. He talked about the Fermi Paradox, and how we are at a point in time where it’s possible to become multi-planetary. It's not known how long that window of time will remain open.
SPEAKERS
It was wonderful to hear @johnkrausphotos@esherifftv@NASASpaceflight and @AustinDeSisto speak.
I am sure they will report on the Twitter Space so check them out.
There was just under 4000 listeners, Elon did not have much time because he had to get back to work. A reporter from Reuters @joroulette was there, and wanted to know the planned launch “cadence.”
The space ended abruptly as something went wrong with the connection.
Thanks to @elonmusk for hosting the Space! This article by @GailAlfarATX please credit accordingly.
───── ⋆⋅☆⋅⋆ ─────
Been meaning to share my own personal finance learnings / experience over the years.
Dual objectives - a) get feedback from community on what I can do better and b) help someone less experienced accelerate their own journey
Alright - let's do this.
(1/n)
Lot going on here, but 2 big points:
1) Accuracy and objectivity are separate things. Further a journalist or brand is from the North Star, less useful they are.
2) When brands are honest about their position in this matrix, they're not doing harm. It's deception that's harmful