Likely outcome for a "normal" AGI/ASI future is an optical minimization of AI's presence in daily life, creating a mirage of human agency while benign ASI finely tunes our seemingly pedestrian reality via a trillion micro-optimizations every second
I think a lot of the concern isn't just that we lose purpose via humans having labor value and thus no capital J Jobs, but a broader concern (with many second order consequences) of the universal, not yet commodified human intelligence bottleneck to everything suddenly becoming cheap and commodified
@aidan_mclau@tszzl When they ship things to Fiji that they can't produce themselves in container ships, it's more efficient that the ship isn't empty when it leaves. That Fiji has a designated export they can sell at a profit is more efficient than the alternative.
Just a reminder that in a pond where the number of lilypads double each day until they cover the entire pond by day 30, the day the pond is only half covered is day 29.
Being ASI-pilled should would likely make one discount the value of money in the long-term, thus any long-term bets involving money made now would reasonably be weighted only on futures where ASI isn't achieved.
@DaveShapi Capitalism is based on exchange: entities with different information profiles exchange X for Y because side A values X more than B and B values Y more than A. As long as ownership and information gradients exist, capitalism will exist in some form.
@AbHomineDeus I think most people's concerns aren't about wealth distribution in the even of superintelligence, but rather if progress is slowed and AI is regulated in a manner than allows only certain wealthy people (gated by capital social networks) to access raw model outputs
@EpistemicHope Many LessWrong conclusions are just simple common sense, it's just the that the information commons is so muddled and polluted. Their superpower is reasoning simply, not coupling all their neuroses and wishes for what ought to be true (surprisingly very hard for many to do!)