I have thought about this since the 1970s. See the summary in Sec. 20 of reference [1]:
What will supersmart AIs do? As indicated above, they will start by transforming the solar system through countless self-replicating, self-improving robot factories. But that won't be the end of it. In a few hundred thousand years (just a moment on a cosmic scale), they will have transformed the entire galaxy, which has a diameter of about 100,000 light-years. (The last millennium saw many reasonable proposals for interstellar travel, which is much easier for robots than for fragile humans.)
Over time, AIs will set up physical senders and receivers everywhere, allowing them to travel by radio, just as they do in our labs today. In a few tens of billions of years, they will have transformed the rest of the reachable universe. Despite the light-speed limit, the expanding AI sphere will have ample time to colonize and shape the entire visible cosmos [TED12][SA17].
Perhaps all of this has already started elsewhere in the universe. Then why don't we see any signs of intelligence out there? (The Fermi paradox.) I've thought about this a lot.
When I was a boy, I read about the vast empty spaces observed between clusters of galaxies. My first idea was that they were expanding bubbles colonized by AIs that used most of the local energy, making those bubbles appear dark. Then, I learned that gravity itself is sufficient to explain the sparse, large-scale network structure of the universe.
Next, I thought that the mysterious "dark matter," which makes up most of the universe's mass, might be stars whose energy is used by AI civilizations whose communications are so well encrypted that they appear as random noise to us. However, this also seemed implausible because dark matter is present in all galaxies, including our own. So, why are there any stars left in the Milky Way whose energy hasn't been used yet?
And why aren't we bombarded with non-encrypted construction plans from AIs that want to spread via radio without first building physical receivers far from their origins?
Today, I think it's possible that our planet is the first in our light cone to spawn an expanding AI bubble. Earth's multi-billion-year window for biological evolution is almost over. In a few hundred million years, the sun will be too hot for life as we know it. Perhaps humans were incredibly lucky to evolve in time to invent agriculture, civilization, book printing, and AIs just a few hundred years later. If we are indeed the first, then this implies a great deal of responsibility, not just for our biosphere, but for the future of the entire universe. Let's not mess this up.
[1] Annotated History of Modern AI and Deep Learning. Technical Report IDSIA-22-22, IDSIA, Lugano, Switzerland, 2022-2025. Preprint arXiv:2212.11279. https://t.co/Ys0dw5hSuC
Extremely rare video!
Pavel Sudoplatov, the Ukranian spymaster and NKVD agent behind the operations that killed Trotsky and Konovalets ( OUN leader before Bandera ) , gives his last interview. Filmed at home in 1992, age 85, he tells how he infiltrated the Ukrainian nationalist underground in Nazi Germany, how Stalin personally approved the Konovalets hit, and why he regrets nothing. English subtitles added by me.
@SeanTrende Half of the United States currently believes "millions" of children are being trafficked every year as part a secret elite cult. No shit they don't let their kids go outside.
Grotesque creatures, surreal imagery, and some seriously unsettling stop-motion animation. FAUST (1994) is the kind of underground horror oddity that reminds you just how wonderfully weird horror cinema can get.
Language models are now writing neural network weights directly. No gradient descent. Just reasoning. In one EEG experiment it matched standard training with 6x fewer subjects. Training is turning into thinking. (Mixed Signals, EPFL) https://t.co/s3TpEKjg7w
In democratic societies, everyone has *some* responsibility on how the use of technology maximizes benefits and minimizes bad side effects.
The benefits of AI are real today, and will greatly expand in the future.
The bad side effects have, so far, been minimal.
It's on all of us to make sure it remains that way.
The catastrophe scenarios (extinction, employment apocalypse, etc) are totally ridiculous for anyone who understands how thing work in the real world.
And the p(doom) estimates are all pulled out of their authors' back ends. It makes no sense to attribute a probability to events over which we have complete agency. Whatever probability you come up with merely reveals your lack of confidence that your fellow humans will do the right thing. Confidence in humanity is one thing Geoff and I disagree on.
The other thing we disagree on is the primacy of intelligence. In the real world, intelligence is not synonymous with power and dominance. A virus, a poisonous snake, or a tiger can bring down a human. Lots of very stupid humans dominate much smarter ones (just look at the international political scene).
Superintelligent AI will work for us and do our bidding, subject to safety guardrails.
It will have no desire to take over.
I have made detailed technical proposals for AI architectures that can be made safe by satisfying safety guardrails at inference time.
I call it Objective-Driven AI Architecture.