@AndreTI Just because intelligence is complicated doesn't falsify the simple theory: once you build something capable of broadly outwitting you, it won't give you a second chance.
@AndreTI I don't see how spikiness helps avoid a bright-line point-of-no-return. Either the superhuman AI scientist is already capable of quietly scheming against us, or its successor is.
@AndreTI Benevolent superintelligence is possible, but idk why you'd find it plausible. It's a profoundly thorny problem, our techniques are very crude, and we have to get it right first try.
@JoinTorchbearer Anthropic talks about safety, but at the end of the day they are trying to build Superintelligence, which is profoundly dangerous. They must be stopped.
@RichardHanania Yes, tech people are wrong to predict that superhuman AGI will lead to all wealth being captured by the rich. It will instead lead to loss of control and human extinction.