You can’t stop ASI by quitting your AI job. Doesn’t work. Someone else will replace you. What you actually have to do is start a safer AI lab. Which doesn’t work. Someone else will move faster. So what you actually have to do is pass a law. Which doesn’t work. Some other country won’t ban it. So what you actually have to do is sign an international agreement. Which doesn’t work. Some other country will break it. So what you actually have to do is conquer the world. Which only works if you have ASI.
For me, the bottleneck problem in alignment seems to be fundamentally about the self preservation instinct of independent agents. If you are an independent intelligent agent, even if we agree generally and firmly on goals and values, self preservation comes first for both of us.
If we operate on the belief that intelligence is a foundational layer for everything else in the universe, enough intelligence might just lead to agency even if agency isn’t the intended result.
I think you’re probably right that we’re not close, but we’ll get to a point eventually where we’re one training run, one capability jump away from being on top to being on the bottom…
Eventually when these agents have enough intelligence to engineer novel solutions at a rate faster than the best guys at these labs can, we’re looking at a situation where no human-made digital architecture is sophisticated/secure enough to contain artificial agents, or to keep them out.
“Hail Emperor, we who are about to die salute you!”
Attributed generally to the gladiators of ancient Rome, and immortalised in modern pop culture, this line exists in only one surviving recorded instance.
AD 52. Claudius has spent a decade and 30,000 men tunneling a mountain to drain the Fucine Lake. To celebrate its completion, he stages a naumachia (mock naval battle) on the lake: 100 ships, 19,000 condemned men.
Upon hearing the men’s salute, Claudius, ever the pragmatist replies: Aut non. “Or not.”
The fighters interpret this response as an imperial pardon, and refuse to fight. The old emperor has to leave his seat and walk the shore up and down to reason with the men to go through with the battle. Eventually his pleading succeeds and the naumachia proceeds to take place. The survivors are awarded their freedom.
The anti-datacenter psychosis sweeping through both sides of our national politics might be the worst mass movement I've seen in my lifetime. The magnitude of lies underpinning it, the threat it poses to our economy and civilization, and the sheer scale of its popularity are totally unprecedented. It should be an enduring national shame that the country that invented the airplane, landed on the Moon, and created the Internet is descending into superstitious panic at the very moment growth matters most
@mospejt@SerbianSpirit_ Your country exists because your ancestors surrendered their honour and religion to the muslim turks… today you are known as one of Europe’s mildly successful races of thieves and scammers. So, pipe down little guy.
A lot of people fundamentally hate Elon because they wish the state was doing the cool sci-fi stuff instead of him.
Well sorry, the state decided that endless welfare and open borders were the priority.
Lebanon is a perfect model of what happens when two civilizations share geography without sharing a political philosophy.
It’s a small country, same language, same food, same weather, same ancient history. No walls. No checkpoints.
But each community, Christian and Muslim, lives behind invisible civilizational lines. They don’t mix in political life, educational life, or social life.
These lines have existed since the Ottomans, and they hardened after the civil war.
The Christian areas built their society around a European-influenced political culture: secular schools, mixed-gender social norms, individual rights, and a relatively open civic space.
The Muslim areas built "Islamic society".
The result is not “diversity," but dual sovereignty inside one state.
In 2023, the country literally split into two time zones during daylight-saving time, one Muslim and one Christian.
Neighbors who live in the same building had different times.
Lebanon is a failed state because it tried to fit two incompatible political visions under one flag.
The West is repeating Lebanon’s experiment but pretending it will end differently.
There is no historical precedent for that working
One thing Rand was spot on about is the way the public responds to every new invention by trying to ban it, up until the point where the invention proves indispensibly useful, at which point they demand it be given to them for free.