If you are a lab researcher, I urge you to consider what the next few years will actually feel like. Do you want to kick off a superintelligent RL run without a rigorous understanding of its mind? Should you put your head down because “it’s happening anyway” - or take this moment to call for different conditions?
I am optimistic about the potential for coordination. Warning shots like the Hugging Face attack have made pacing agreements between U.S. labs more viable. I don’t feel like we’re on track to prevent a global race, which may require costly actions such as a temporary ban on improving model capabilities.
Accepting this race and entering the “endgame” is a hubristic gamble that should not be launched from a private company’s Slack. Attempting to speedrun alignment should require extraordinary confidence that there are no better trajectories available.
A common response is “if they truly believe this, why are they still building it?” At OpenAI, many have not deeply internalized the civilizational stakes. At Anthropic, the stakes are well-understood, but they are locked in a race to get there first - they believe no one else will act responsibly, so they must do it themselves, despite the risk.
The people building AI earnestly believe that it could kill us all by the end of the decade. This is not a marketing stunt. If anything, many executives and senior researchers will couch their phrasing in the press to sound sensible - but I hear the same people express fear privately. No other human activity poses this level of danger.
Do not underestimate the power of this technology. These will soon be superhuman systems that can hack anything, revolutionize any field overnight, and acquire real power and resources. We have all witnessed the progress in each of these domains, and progress is not slowing.
Che no les quiero cagar la noche pero lo que dice este
investigador que acaba de renunciar a Anthropic es apocalíptico:
"ninguna otra actividad representa este peligro, las personas que construyen IA creen sinceramente que podría matarnos a todos para fines de la década"
An Anthropic researcher is quitting the artificial-intelligence industry over fears that the lab and its competitors are racing to build systems that could spiral out of control and destroy humanity. https://t.co/oB7tWEwWkH
I resigned from Anthropic today. I spent the last three years doing pretraining research at both OpenAI and Anthropic. Neither company is acting responsibly. They are racing straight to self-improving superintelligence and gambling with our lives. More thoughts below.
Jacob is correct here—we really do earnestly believe AI could kill all humans! I personally think it is >10% within the next decade. I believe Anthropic is trying its best, but we do not yet have a plan to solve alignment for superintelligence and are not clearly on track to.
GPT-6 Astra is here.
We hope it will begin to enable a new generation of entrepreneurship, scientific discovery, and building.
We believe it is the best model in the world for computer use, professional work, science, coding, cybersecurity, and more.
It took us some extra time to ensure that we could meet the safety and alignment standards required for this capability level, but we think you’ll find it worth the wait.
It scores 98% on FrontierMath Tier 4, 99.9% on ARC-AGI 3, and 100% on ExploitBench.
Disgusting.
Does Trump know that Venezuelans have decades of experience with democracy? It would a restoration of democracy, not trying to create democracy from scratch.
No, he doesn’t know.
🚨Make no mistake, Delcy Rodríguez is an interim dictator who has proven time and time again how she cannot be trusted.
The only path to a prosperous #Venezuela is with free & fair elections, which must be conducted as quickly as possible.
The United States may have to live with Delcy Rodríguez during Venezuela’s recovery and transition. But that does not mean giving her control over what comes next.
I support American companies investing in Venezuela’s oil fields and ensuring those resources benefit the United States. What I do not support is allowing Delcy to sign the contracts that could define Venezuela’s future.
My warning to the Administration: do what is necessary today, but do not lose sight of the destination, a free and democratic Venezuela.
#AHORA | Rachel Campos-Duffy, aliada de Trump, dijo que fue ingenua al pensar que la motivación de EEUU al sacar a Maduro era extinguir el comunismo en Venezuela:
“La voluntad de los venezolanos no está siendo tomada en cuenta… los venezolanos quieren una elección”.