New essay exploring why experts so strongly disagree about existential risk from ASI, and why focusing on alignment as a primary goal may be a fundamental mistake
@Noahpinion@jasoncrawford Also A Fire Upon the Deep (also Vernon Vinge). Archaeo-AIs have to acquire resources in order to bootstrap their performance IIRC.
@modernmoderate3@OriginMaterials The vast majority of my net worth is already in ORGN, and I’ve paid more in taxes on ORGN stock exercises than I have in my 401k.
Your definition of an entrepreneur leaning in seems to be “be rich already so that you can plow more cash in whenever you want”.
@jasoncrawford@curiouswavefn This is basically the message Andromeda Strain tried to convert, and I can’t think of a notable time that that hasn’t been right.
@jasoncrawford@curiouswavefn It always sounds scary on paper because you’re reducing the full complexity of fitness to just a few dimensions, but the reality of the environment dominates the new capabilities for selection of the organism.
@EliotJacobson We’re gonna make it. There’s too much adaptability, variety, and grit in humans to be beat by a few generations that made a few bad decisions. Could it have been easier? Sure. But we’re still gmi.