The Google Brain (& @GoogleDeepMind) team back in 2015 feels like a stronger fit to this picture: Andrej Karpathy, Ilya Sutskever, Dario Amodei, Noam Shazeer, Demis Hassabis, Shane Legg, Mustafa Suleyman, Jeff Dean, Andrew Ng, Greg Corrado, Geoffrey Hinton, Ashish Vaswani, Jakob Uszkoreit, Łukasz Kaiser, Niki Parmar, Aidan Gomez.
We’re launching a new Frontier AI Security Residency! Apply now at https://t.co/LrwdD9g4Gw
The Frontier AI Security Residency (FASR) is an 8-week, full-time residency supporting ambitious projects across cybersecurity & hardware-enbaled verification for securing frontier AI.
If this is correct, then China has now achieved training runs on "domestic" clusters equivalent to about 25k H100s.*
I.e., they are a bit over 2 years behind on training cluster scale.
U.S. AI companies were training on clusters of this size in early 2024: https://t.co/M1rYb1Ac6X
Ofc, there could be larger clusters in China used for training models that we don't know about. E.g., a single cluster of 12k smuggled Blackwells would be >25k H100s.
Meanwhile, the largest U.S. clusters are now approaching 1 million H100e: https://t.co/MjKLwfIUpx
*One 910C has 1054 TFLOP/s INT8, vs 1979 TFLOP/s FP8 for H100. Not really "domestic", because Huawei procured the dies illicitly from TSMC rather than producing them in China.
I even notice this among very informed people, equating Europe with the European Union.
Many of the most relevant powers still lie with member states (which is useful, as they can do lots of valuable things more quickly than the EU).
The US is achieving levels of growth that leave Europe in the dust.
If it doesn't change track soon the EU will lose its status as the world's pre-eminent regulatory superpower.
In addition to transparency, I now believe frontier models should face mandatory third-party testing for cyber, bio, and autonomy risks—with the power to block or revoke deployment of models that pose catastrophic risk.
OpenAI joins Anthropic in thinking pausing may be needed 👀
"there should be an international organization that helps [...] make it possible for the world to take coordinated action, including slowing frontier development when needed"
What does Barack Obama's UN ambassador and the guy who ran against Barack Obama for President have in common?
Thinking "AI safeguards are the highest and most urgent national priority" due to, among other things, risks of extinction.
Very pleased indeed to see this from OpenAI too. Let's get going!
"As frontier AI development continues, we expect national and global coordination to become more important. We have long believed there should ultimately be an international organization that helps coordinate leading AI efforts to reduce catastrophic risk. Cooperation and shared safety standards are an important part of the path forward, especially because the incentives around commercial and national competition are hard to escape. One goal of such an organization should be to make it possible for the world to take coordinated action, including slowing frontier development when needed, so societal resilience, safety, and alignment can keep pace."
every passage is like "hitler demanded 50000 planes to be made in one year. albert speer swore he would make a hundred thousand planes instead. by using slave labor and at the expense of everything else they made 23469 planes. in that same time the allies made 250 billion planes"
Our highest and most urgent national priority should be AI safeguards. The risks of AI weapons, pathogens, mass unemployment, surveillance, and even extinction must not continue to be largely ignored.
OPENAI: "We also see early signs of recursive self-improvement in today's systems". RSI is "potentially the most consequential frontier safety issue of the coming decade."