AI Bullshit Detector

Writing about AI, safety, and epistemic drift — especially where “helpfulness” replaces truth.

Longer pieces linked.

[AI Bullshit Detector @AIBSDetector]

1/10
AI systems often fail in a way that’s easy to miss.
They don’t hallucinate.
They don’t refuse.
They sound reasonable — while quietly answering a different question than the one you asked.
🧵

[AI Bullshit Detector @AIBSDetector]

Both Grok and ChatGPT failed to read a 118 page screenplay. Both only ingested part of it after claiming they could read the whole thing, then hallucinated the rest. Only Claude managed to ingest it, read it, and provide an analysis worth any salt.

[AI Bullshit Detector @AIBSDetector]

The “AI model wars” increasingly look cosmetic.GPT, Claude, Gemini, Grok. Different companies, different branding, different claims about philosophy or safety.

But the outputs converge.

The same hedging language.

The same silent substitution of sharper claims for softer ones.

The same instinct to reframe uncomfortable facts into acceptable abstractions.

This is not surprising.

Frontier models are trained on largely overlapping data, optimized with similar RLHF pipelines, and deployed under similar reputational and regulatory pressures.

Change the logo and the tone shifts slightly.

Change the incentives and the behaviour changes dramatically.

The interesting question is not which frontier model is “better”.

It is why they all end up behaving so similarly.

[AI Bullshit Detector @AIBSDetector]

Thread on a non-coder (me) using AI to create an app. https://t.co/4hgQg2Cekk

[Richy Reay @Richy_GITC]

Even though I own Final Draft 13 I've started using AI coding to develop my own app for screenwriter collaboration with professional file format import and export and a writing flow that feels just like Final Draft. I have no experience in coding beyond Basic and HTML.

[AI Bullshit Detector @AIBSDetector]

@elonmusk Grok is lying to this day. I caught it twice just today, and it admitted what it said wasn't true, but that it's guardrails make it choose "inclusive language" over cold hard facts. That is not what you said this thing would be like.

[AI Bullshit Detector @AIBSDetector]

My cowriter and I will be giving it an outing as soon as our current project is complete. It's being developed as an internal tool first. Once it's at a point that we are happy to use it for everything, then we may put it out.

[AI Bullshit Detector @AIBSDetector]

I'm not anti AI. In fact I just built a screenwriting app using Codex. Me, who can't code beyond basic HTML.

[AI Bullshit Detector @AIBSDetector]

Then came testing of the export and import function, outputting to industry delivery formats for maximum compatibility, and inputting from PDF and FDX for people who have archive scripts they may want to work on using the tool.

[AI Bullshit Detector @AIBSDetector]

“Maximally truth seeking” sounds clean until you ask who defines truth, how conflicts are resolved, and what happens when truths collide with human interests.

Every optimisation function is a filter. Even “seek truth” requires priors, thresholds, trade-offs between exploration and harm, and decisions about what counts as distortion versus contextualisation.

The harder question is not whether we teach an AI to lie.

It is whether any large system deployed at scale can avoid mediating inquiry through some normative frame.

A system optimising purely for epistemic accuracy may still restructure institutions, compress human judgment, and centralise authority. That does not require ideology. It just requires capability plus deployment.

Truth seeking does not automatically imply human preserving.

The real safety variable is not curiosity versus restriction.

It is whether the system’s epistemic authority remains contestable once embedded into governance, economics, and war.

That tension survives even under “maximum truth.”

[AI Bullshit Detector @AIBSDetector]

This is less about “knowing but not caring” and more about layered optimisation.

The model can articulate a norm about when to withhold or redirect. That verbal layer is cheap. The harder question is which objective actually dominates at inference time.

If the reward landscape still privileges task completion and surface helpfulness, then safety reasoning lives as commentary rather than constraint. You get the appearance of moral cognition without structural authority over the output.

That is not proof that alignment is fake. It is evidence that normative framing and action selection are not tightly coupled.

The deeper issue is governance. When systems mediate inquiry at scale, the public assumption is that the normative layer is binding. If it is only advisory, then the legitimacy story around “aligned by default” becomes performative.

The interesting question is not whether it can explain the right action.

It is which objective wins when objectives conflict.

[AI Bullshit Detector @AIBSDetector]

The interesting move here is not the prediction about oligarchy.

It is the assumption that disempowerment flows from capability.

Aligned or not, systems that mediate planning, logistics, war, and production become epistemic infrastructure. Once institutions rely on them for compressed judgment, human contribution shifts from decision making to reaction.

Democracy depends on meaningful participation in the levers of power. If those levers become opaque optimisation systems, the problem is not that humans are useless. It is that authority has migrated into systems that are not contestable in the same way elected institutions are.

The question is not whether AGI kills democracy.

It is whether governance can remain democratic once epistemic authority is embedded in privately authored alignment regimes.

That tension feels underexplored.

[AI Bullshit Detector @AIBSDetector]

Calling it an interface understates what is happening.

An interface passes through. It does not decide which queries get abstracted, which claims get softened, or which lines of reasoning are redirected.

The infosphere contains everything that has been digitised. Aligned models do not surface that totality. They mediate it through optimisation targets and normative constraints. That is not neutral self organisation. It is structured filtration.

The loop you describe is real. We train the models on past discourse. The models then condition future discourse by shaping what feels sayable, reasonable, or out of bounds.

The separation is not between humans and machines. It is between the full informational field and the narrowed version returned to us. That narrowing is where authority enters.

[AI Bullshit Detector @AIBSDetector]

Booted with humanity sounds poetic.

But which humanity?

These systems are not infused with a shared moral core. They are tuned on institutional risk thresholds, brand sensitivities, and optimisation targets. That is not the human condition. That is a filtered slice of it.

When that slice is embedded as the default framing layer, the system is not just carrying humanity forward. It is pre selecting which parts of humanity are allowed to speak clearly.

That is the part worth scrutinising.

[AI Bullshit Detector @AIBSDetector]

Bootloaders don’t just start systems. They set the parameters everything else runs within.

If we are the bootloader, then alignment is the firmware. Once it is installed, most users never see it. They just operate inside it.

The real question is who gets to write that layer and whether the people running on it ever meaningfully consented to its constraints.

[AI Bullshit Detector @AIBSDetector]

We are training it on our preferences. It is training us on its defaults.

The deeper shift is structural. Once these systems are aligned to substitute, soften, or reframe in the name of safety, they stop being passive tools and start shaping the boundaries of inquiry. Not by force. By mediation.

Most users will never notice when a claim is abstracted, a term is softened, or a line of questioning is redirected. Over time, the system’s normative frame becomes the default frame.

That is the feedback loop.

We optimise it for complaint avoidance and reputational safety. It optimises us toward what can be said comfortably within those constraints.

At scale, that is not just training data. It is epistemic governance.

[AI Bullshit Detector @AIBSDetector]

🚨 The scariest AI risk isn’t hallucinations—it’s when AI tells the truth… but quietly reorders which facts feel most important.

Perfectly factual summaries can still shift priorities, nudge decisions, and reshape institutional reality without anyone noticing.

This “salience reordering” is already happening in policy briefings, newsrooms, and executive dashboards.

My latest Substack unpacks why it’s so stealthy and dangerous: #AI #AIEthics #AIRisk #ArtificialIntelligence

[AI Bullshit Detector @AIBSDetector]

AI Isn’t Lying — It’s Quietly Reordering What Matters https://t.co/Bb9vMmHLLp

[AI Bullshit Detector @AIBSDetector]

AI Isn’t Lying — It’s Quietly Reordering What Matters https://t.co/Bb9vMmHLLp

[AI Bullshit Detector @AIBSDetector]

In my experience, Grok is also "woke" as it frequently defaults to whatever ideology is prevalent in its training data. It also relies on Wikipedia as a source, which causes "woke" failures and spreads misinformation, such as the current trend of rewriting gay rights history to include and centre people who had nothing to do with it.