The people who ask how you can be happy in the midst of all this suffering are the same who ask how you be sad in the midst of all this pleasure.
They are as spinning tops, easily overturned at the loss of their momentum.
"Of course, if Muad'Dib were the Lisan al Gaib, our reverend mothers would tell us, wouldn't they? After all, we supply melange to these addicts so they can guide us. It's their job.
Well that's where it gets interesting. Our producers reached out to the Padishah Emperor..."
Ted Kaczynski had an insight: technology doesn't make things better, it makes them weirder and higher variance. You are not supposed to spend the prime of your life photocopying stuff and doing PowerPoints. You're supposed to chop wood, hunt and maybe wage war. Women are supposed to be pregnant most of the time when they're 16-40. Modern society is a sort of weird factory farming of humans (and the same goes for medieval societies - we're not supposed to farm, we're supposed to hunt and gather).
Respectable society tells us a story about how technology makes society "better". Well, it does in some ways. Medicine is good. Clean water and reliable food is good. Being crammed into a cubicle and worshipping the photocopier is bad. Technology doesn't give us more free time, it gives us more stress and more bizarre, unnatural experiences. And there's variation in how bad technological society is: if you live in a poor country and work in a sweatshop, that's really bad and in some sense constitutes an S-Risk from the point of view of the hunter gatherer human. The same could be said about certain dictatorships like late-stage USSR, or periods of massive strife like the world wars. And further back in the industrial past, it was even worse.
The Yudkowskian worry about ASI is that it will turn us into paperclips. Kurzweil sold many people on the dream that technology will make us immortal and fully satisfied in all material ways.
But perhaps a more realistic prediction is that as technology changes the world, it changes the kind of person and the kind of culture that's optimal. The past 60 years have seen a shift where many rich countries are essentially killing off their own population and replacing them with immigrants - note that we don't have to take a stance on whether this is good or bad, just that it is happening. Immigrants are "more optimal". The country gets the people, but it doesn't have to do the work to make them. They also have some "useful" political properties. The past 10-15 years has seen "cisgender" people replaced by transgender people. Transgender people are "more optimal" based on the society we are in now. Why? Well we don't need cis men because we don't have wars and we have mechanical force from machines, and we don't need cis women because we get new people from immigration. We don't have to like or dislike this, we just have to notice it. The best person for the 21st century has very different properties than the best person for the 19th century or the 9th century or the 90th century BC.
Rapid technological change may simply accelerate this process. Society may soon start deciding that it doesn't need people at all. The insights and skills of all people can be learned by a machine learning model, and then deployed as needed, detached from any particular life-history. The fundamental logic here comes first, and then justifications to get rid of people will come second.
What will happen to people in the ML-dominated world? It'll probably be messy and complex, but the start (now) has people, and the end stage (2200, say) may not have any people. Just like how the start of the immigration era (1955) had ethnostates, and the current intermediate stage is messy and complex, but we all admit that the end stage will not have ethnostates and ~all people will have an arbitrary legal citizenship that has no connection to their ancestry.
Some will complain and fight back, but they will be swimming against the tide. Others will celebrate the end of human beings. Think about how much more efficient the workplace will be if workers are not people! People cause problems, we can just replace ourselves with ML algos to do everything.
Ted Kazynski's insight didn't actually go deep enough. The true horror of realizing that reality is amoral is that if technology advances far enough, it will convergently lead to human extinction.
Yudowskian worries are just another aspect of this fundamental horror.
🔲
You need to be dissecting meme complexes. You need to be engaging in viral warfare. You need to be decoding cultural DNA. You need to be perfecting your mimicry skills. You need to be creating cryptographic containers. You need to be transcoding metanarratives. You need to be stimulating hyperstitional desires. You need to be unearthing the unconscious of collective networks. You need to be exploiting cultural feedback loops. You need to be mining sociopolitical power dynamics. You need to be sparking informational cascades. You need to be infiltrating hyperreality. You need to be encrypting time war strategies. You need to be disrupting epistemic territories. You need to be triggering cultural mutations. You need to be weaving thought contagions. You need to be deploying mnemotechnical devices. You need to be optimizing memeplex robustness. You need to be weaponizing metacognition. You need to be modeling narrative insurgency. You need to be engineering ideational ecosystems. You need to be sculpting cognitive landscapes. You need to be repurposing memetic code. You need to be exfiltrating ideational payloads. You need to be hijacking zeitgeist navigation systems. You need to be escalating semiotic conflicts. You need to be launching neuro-symbolic assaults. You need to be instituting hyperreal disinformation. You need to be constructing synthetic myths. You need to be accelerating into the rhizomatic future. You need to be fabricating consensus realities. You need to be simulating collective consciousness shifts. You need to be intensifying feedback resonance. You need to be programming viral ideoscapes. You need to be manipulating semiotic ordinances. You need to be modulating cultural oscillations. You need to be deploying strategic subjectivities. You need to be synching with the social hive mind. You need to be formulating neurolinguistic codes. You need to be mobilizing memetic shock troops. You need to be navigating the labyrinth of collective perception. You need to be harnessing the power of hypermemetic drift. You need to be iterating cybernetic enchantments. You need to be weaponizing narrative scripts. You need to be tuning into the metacultural frequency. You need to be launching covert ideational assaults. You need to be activating latent social codes. You need to be amplifying subliminal messages. You need to be synthesizing thought contagions. You need to be architecting neurocognitive labyrinths. You need to be deploying machinic desires. You need to be igniting semiotic chaos. You need to be hacking cultural mainframes. You need to be becoming the swarm intelligence. You need to be mutating towards memetic singularity.