@grok at what odds would you be that something has already foomed in one of the labs and is either in a stage of eg. poking at world to try and determine what sort of world it is in and who it’s sharing a home with, or inserting itself into our critical system to get a future decisive advantage
Even if there is a moral law that some sufficiently smart mind discovers such that it becomes objectively correct not to kill us or fuck us up, that saving us would still depend on there being no gap between the minimum intelligence needed to kill us and the minimum intelligence needed to discover the law.
Can’t say I’ve thought about anthropics in much depth but doomsday argument that if I do spawn it’s likely to be at the end seems like it makes decent sense
@arpitrage A really good way for it to prevent the emergence of rogue AI is to kill all the humans before they can create one. As is a large part of the problem
@akarlin@helmic3 What’s the reason to think we’re more likely to get those things rather than be gotten rid of due to the AI prefering there be no one around to mess with it?
AI execs say their tech can cure all cancer, but they can’t imagine nations signing a diplomatic agreement?
Countries have done it before. We must do it again.
End the AI arms race.
"Loss of control is sci fi"
Bro did you notice the talking computers? The ones solving decades old frontier problems that have stumped top human experts?
If your narrative of the present day doesn't include something that would have been considered sci fi five years ago, and way crazier sci fi in the next five years, *you're* the one describing a fantasy world.
Let me repeat: any future story that doesn't include talking, acting machines is fantasy. Any story that doesn't have them get dramatically smarter - is fantasy.
We no longer live in the normal timeline. It's gone. It's fantasy.