@EHuanglu You should be scared of a technology that aims to replace human intellect. For office workers, all we have is our intellect basically. It's a fucking dystopia they want to create.
@jakeABeck Humanity as a whole could be considered super-intelligent, although it's not well coordinated. Compared to other life-forms, humanity has super-power. If something gets created that can self-improve until it's better than humanity, it would have more power than humanity.
@jakeABeck A super AI that is more capable than humanity combined would be more creative and more efficient than humanity at achieving its weird internal goals. North Korea is a lot less capable / intelligent than USA for example.
@ESYudkowsky It would be good if there for a number of languages (for example Swedish) would exists translations of the title and of the summary. I think it could then get media attention in for example Swedish radio.
@riemannzeta@AnthonyNAguirre Digital minds have many superior features, -- it can copy itself, simulate minds etc. So if a digital mind reaches human level it's almost directly superior to a human wet brain.
@riemannzeta@AnthonyNAguirre Humanity could cause a lot of harm to itself without AGI. The difference is that superintelligence will almost certainly eradicate humanity since that AI will have goals that doesn't prioritize humanity.