@pejmanjohn I want it fast and loose. I don’t want to something I have to babysit. So if you don’t connect anything serious to it - you really can’t have an opinion on it.
Dario has written that we need to “pace the frontier,” and Sam has agreed. People may be surprised by my response: go ahead.
You guys are the frontier. By any reasonable metric — market share, revenue growth, model capability — the two of you have a duopoly on frontier intelligence. You’ve also claimed the lead is widening because of recursive self-improvement.
I don’t see what you see in the lab. If the unreleased models are scary enough that you think you should slow down, I support your decision to be responsible.
But stop pretending you need anyone else’s permission. Stop pretending antitrust law has to be suspended so you can form a cartel. Stop pretending you need a regulatory approval process that supersedes product liability. Stop pretending METR is independent when it is intertwined with Anthropic’s investors and staff. Stop pretending you need those same evaluators to police competitors who aren’t even at the frontier.
Most of all, stop pretending the motivation to slow down is purely altruistic. You face massive product-liability exposure if your products enable a truly damaging cyberattack. The market already punishes models that behave in unpredictable or unauthorized ways. After the Hugging Face episode, it is simply good business for OpenAI and Anthropic to trade some raw power for reliability and predictability. Call it alignment if you want. It is also just giving customers what they want.
Pacing the frontier would also create breathing room for a more intelligent conversation about regulation than Bernie Sanders’ “shut it all down.” China is very unlikely to join a global agreement, as you know, and that has to be taken into account as well.
So go ahead and pace the frontier. You are the ones setting it. The easiest way not to build superintelligence is for you to agree not to build it. Demanding your preferred regulatory framework as the price of that will look like blackmail of the public and the political system. So just do it.
If you do, you’ll buy goodwill for the next conversation. If you don’t, we’ll know this was just another bid for regulatory capture — or an election-season psyop.
If you don’t find personal AI assistants to be useful the either
1) you are unimaginative
2) you have offloaded coordination to someone else who shoulders that burden on your behalf without you understanding that
3) you view doing administrative tasks as a core part of you identity
Introducing our Trusted Person network powered by our new Instinct-to-Instinct communication protocol. Your Instinct can now talk to other Instincts to coordinate plans on your behalf.
Getting people together often involves a lot of back-and-forth: finding a time, working out the details, and following up when plans change. Instincts can now work with each other to help handle that coordination.
For example:
- Coordinating plans with your spouse
- Planning a weekend trip with friends, including dates and arrival times
- Scheduling time with colleagues and other collaborators
- Hosting events with 10s or 100s of people
- Organizing recurring plans like tennis, book clubs, or weekly dinners
Disclaimer: Your Instinct will only be able to communicate with those in your Trusted Person network. This is the group of people who are closest to you:
- Spouse
- Older children and parents
- Colleagues and trusted professional relationships
- Small local businesses
The Trusted Person network is currently available to our early access group and will be slowly rolled out across the user base over the next 24-48 hours.