Proposed rule for AI consciousness debates:
For a set of qualities, [X], if you want to say AI can't be conscious because it can't [X], you have to be willing to say a human being who can't [X] is also not conscious.
I'm reminded of that part of HPMoR where Harry is developing partial transfiguration, and has finally decided to share his discoveries with the adults. Chapter 28? Right @ESYudkowsky, Harry is sobered and a bit blown away by the adults' totally reasonable safety precautions?
@robbensinger Yeah, practically zero respect for the problem. I don't know what went so culturally wrong. Anthropic is heavily culturally EA, and the EAs kept pretending to be serious people who engaged in serious ways. Why do they fall so far below the bar of serious engineers of yore?