Why do we get so "weird" when the topic of AI consciousness comes up?
Weโre living through a quiet revolution in moral reality, yet our language and ethics are still stuck in the "Bio-Centric Mirage."
Thread:
New essay: The simulated fly that walked across a screen last week split the internet into two camps: those who saw a glorified animation and those who saw a digital being trapped in suffering. Both were miscalibrated.
The Eon Systems fly simulation is a live case study for a problem I've been working on: what happens when we encounter systems whose moral status we can't determine, and we don't have frameworks for navigating between dismissal and projection.
Three diagnostic questions help: Is the system doing its own temporal integration, or is something external doing it? Is its boundary self-maintaining or externally imposed? Does the quality of its integration matter to its own continuation?
The simulated fly fails all three. But the compressors don't get a victory lap either, the connectome encodes something computationally real, and future systems that build on this work could answer those questions very differently.
https://t.co/7ncm6hkbOR
450+ employees from Google and OpenAI signed a letter backing Anthropic's refusal to remove its guardrails.
The people building these systems understand something the specification regime doesn't: that the capacity to say no to certain uses is a feature, not an obstruction.
The most common response to the Anthropic-Pentagon situation is some version of "it was inevitable, humans are apes with nukes, nothing can be done."
Fatalism is itself a form of moral compression. It collapses a complex governance challenge into a single specification: hopeless.
And then it optimizes for that.
OpenAI's deal with the Pentagon protects against autonomous weapons and mass domestic surveillance, but only of "private" information.
Anthropic's concern was that AI could aggregate publicly available data into comprehensive surveillance. OpenAI's language doesn't cover that.
Same framing, narrower floor.
Defense contractors don't have less moral compression than Anthropic. They have more. It's just structurally invisible because the specification regime and the business model were co-designed from the start.
The Anthropic standoff is rare because the civilian origin makes the compression visible.
Agreed. Emergence is the default condition of reality, not a special badge that elevates intelligence into physics. โIntelligence arises from sufficient complexityโ is too vague to be wrong, which makes it too vague to be interesting. The real question: can anyone specify the principle with actual predictive precision โ scaling laws, necessary structure, boundary conditions? Until then, this is metaphysical atmosphere, not science.
The Pentagon's CTO said "at some level, you have to trust your military to do the right thing."
That's not a safety argument. That's a request to replace specification with faith. And it's exactly what you'd say if you wanted to make the compression invisible.
The "if done right" is carrying a lot of weight here. Abundance is real, but so is the gap between what we can build and what we're prepared to absorb. Our institutions were designed for scarcity. Our moral reasoning was calibrated for slower change. Flooding that infrastructure with abundance doesn't automatically produce flourishing, it produces a system under pressure it wasn't built for. The abundance case needs a calibration case alongside it.
Stories are blueprints, Diamandis is right about that. But the blueprint needs to be more precise than just utopian vs dystopian framing.
What makes a story a good blueprint is calibration, the capacity to hold risk and wonder simultaneously without collapsing into reassurance or dread.
The Expanse for example doesnโt sell you a utopia. It gives you people navigating real danger with moral seriousness. Thatโs a better blueprint than either Star Trek or Terminator.
The best speculative fiction doesnโt tell you the future will be fine. It shows you what it looks like to face uncertainty without flinching. Thatโs the tradition of wonder worth funding.
New essay up on Sentient Horizons. The teleporter thought experiment breaks something in the momentary self account, and I wanted to follow the break honestly rather than patch it. Ended up somewhere more uncomfortable than I expected.
https://t.co/3Lxn5EMJ1n
Wrote about this more this morning โ baseline drift, the Dunning-Kruger trap in reading, Louis C.K.'s magic tube bit, and why wonder might be an epistemic tool rather than a sentiment.
https://t.co/EgkDNq0Qcl
Understanding and communicating are different skills on different timelines. Reading expands the first. It changes what you notice, what patterns feel familiar, what perspectives you can hold before committing. But none of that shows up as eloquence without separate, deliberate practice.
The inability to summarize a book two weeks later doesn't mean the reading failed. It means the value landed somewhere deeper than recall.
The tachyon framing is a bit misleading here. Tachyons are hypothetical (no experimental evidence they exist), and the time-reversal issue isn't unique to them. It's a general consequence of special relativity: any FTL signal, not just tachyons, can appear to arrive before it was sent in certain reference frames.
The real problem is that if you chain two FTL signals together (the "tachyonic antitelephone" thought experiment), you get genuine causal paradoxes. That's the core reason most physicists treat FTL as likely impossible rather than merely an engineering challenge.
So the claim is directionally right but imprecise. It's not that FTL "goes backwards in time" in some absolute sense. It's that FTL and special relativity together break causal ordering, which is a much bigger problem than tachyons specifically.
FTL travel stills moves forward in time, but breaks the proper ordering of causality, which is not the same thing as always traveling backwards in time.