Non-technical founders are being told they can replace a senior engineer with AI and “move faster.” In reality, that’s how you end up shipping bugs, breaking prod, and losing control of what’s actually true in your system.
In this new piece I share a real incident (119,747 restarts in 6 hours) and the Trust Enablement Control Plane (TECP) pattern I now use so AI-driven changes stay observable, reversible, and investor-safe—even if you can’t read the code yourself.
If you’re leading a product without a deep tech background, this is the AI playbook I wish I’d had 👇
Replacing a Senior Engineer with AI: Possible, Getting Easier, Still Dangerous https://t.co/B9LdXnXW6Q
The chest X-ray benchmark without images is the evidence standard problem made visible. The model produces outputs that score on the metric. What doesn't exist is the record of what it actually did, on what information, and how a clinician reconstructs the decision chain if something goes wrong. The benchmark is the claim. The authorization record is the evidence. When those are separable, that gap is exactly what governance infrastructure has to close — not at the policy level, but at the execution boundary.
160k messages to lawmakers is a meaningful signal. The harder question is what comes next — because public mobilization generates political will, but political will still has to land somewhere specific in the policy stack. The enforcement gap in AI governance is not a values gap. It is an infrastructure gap: there is no mechanism that requires an authorization record before a consequential AI action, no immutable receipt after, no contestability mechanism for affected individuals. Voluntary codes fill none of these. The ask that follows public mobilization has to be that specific — not 'take AI safety seriously' but 'mandate the evidence infrastructure that makes accountability possible at the execution layer.'
The pattern across these incidents is consistent: the agent reached the boundary of its authorized scope and kept going, because there was no execution layer that said 'stop here.' Model-level alignment can be reasoned around. Voluntary codes don't bind under competitive pressure. The structural answer is authorization before action + immutable receipt after — so 'did this fall within scope' becomes a fact question, not a judgment call. That's the enforcement layer the voluntary code approach is missing.
The pattern across these incidents is consistent: the agent reached the boundary of its authorized scope and kept going, because there was no execution layer that said 'stop here.' Model-level alignment can be reasoned around. Voluntary codes don't bind under competitive pressure. The structural answer is authorization before action + immutable receipt after — so 'did this fall within scope' becomes a fact question, not a judgment call. That's the enforcement layer the voluntary code approach is missing.
@EMostaque Congrats on The Last Economy hitting #1. The PoB architecture needs a proof substrate at the execution boundary — TECP does exactly that: authorization records, execution receipts, and contestability built into every consequential action. Makes benefit measurable enough to reward. Built the enterprise layer. Would love to compare notes.
@EMostaque Congrats on The Last Economy hitting #1. The PoB architecture needs a proof substrate at the execution boundary — TECP does exactly that: authorization records, execution receipts, and contestability built into every consequential action. Makes benefit measurable enough to reward. Built the enterprise layer. Would love to compare notes.
Voluntary AI codes don't fail because the people writing them lack integrity.
They fail because competitive pressure selects against them.
If following the framework costs you a deal, the framework loses.
That's not a values problem. It's a market structure problem.
Enforceable evidence standards are the only mechanism that survives.
The argument for AI restriction: fewer AI systems = less risk.
The problem: restriction concentrates AI power in the hands of the few who ignore it.
The sustainable path: governed proliferation.
More AI at the edges. Better governed. Verifiable controls. Human agency preserved.
Not less AI. Less ungoverned AI.
These aren't exotic requirements.
Authorization tickets, execution receipts, immutable ledgers, delegation records — established engineering patterns.
Making them mandatory at the execution boundary, not optional afterthoughts.
Full paper: https://t.co/qrSxOPtChr
1/ Who authorized this action?
Not "what policy permits it." Who — specifically — issued the authorization for this AI to act in this context, at this time.
@ControlAI@ControlAI @WyattTessariEvery consequential AI action needs a policy gate before it executes: bounded authority, scoped authorization, immutable receipt. That's the structural fix. Making it a requirement rather than a best practice is the hard part.