Last week Xi Jinping formed the World AI Cooperation Organisation and said we need to avoid “loss of control” over AI.
This morning 1,224 employees of frontier US AI companies put out a statement saying: "We request that the U.S. government support an international effort to develop the technical and governance tools needed to deliberately pace the frontier of automated AI development."
But what would that actually look like?
According to the people who wrote AI 2027, it would mean: a US<>China deal in which every frontier lab’s research is continually open sourced for the world to examine, regulation developed along the way in response to new capabilities that look dangerous, and every new US or Chinese datacenter rigged to self-disable if the deal breaks down.
Theirs may be the most developed vision for international coordination on AI to date.
Even with treaties and regulations to slow things down, they forecast GDP doubling year over year, billions of AIs and robots taking most jobs, a cap-and-trade robot permit plan paying out $1M “citizen’s dividend” checks by 2035, and full superintelligence by 2040.
When I asked @thlarsen and @romeovdean to forecast growth of AI stocks their chart was parabolic. They also think land (which robots can’t make more of) will skyrocket in value.
If they’re right about the effects of recursive self improvement… we are in for an extremely wild ride 🥵😳
In AI 2027, we predicted that AI would take over the world or irreversibly concentrate power.
In AI 2040: Plan A, we've laid out our positive vision for what should happen instead.
Welcome to episode 1 of Buying into the Singularity, a new podcast in which @nnevvinn explores the AI boom from two angles:
1) how to invest and own your share of the AI buildout, and
2) where AI may really take us in the long term
Samo is the deepest thinker we know on the topic of institutions and the people who create and animate them. In this first episode, we trace out Samo's thinking on what's really happening with the AI buildout and what our prospects are of making it to a techno-utopia. His take is very different from most who are concerned about AI risks.