Alistair Croll

Author (@leananalytics w/@byosko; @evilenough w/@emilyjaneross) & functional government ( I chaired that conference you went to that didn’t suck.

[Alistair Croll @acroll]

The asymmetry of the modern age has been: the institution has machines and bureaucracy; the citizen has a phone and their patience.
What happens when the citizens can build machines of their own in a matter of hours?
https://t.co/3CtckkOEWS

[Alistair Croll @acroll]

@lennysan A portable folding second monitor. Around $100, connects and powers from a USB-c link, fits next to your laptop bag, use from anywhere.

[Alistair Croll @acroll]

Ramez doesn’t post enough, and when he does, it’s always an excellent read.

[Ramez Naam @ramez]

🧵New post in my AI series: Can a million parallel agents create superintelligence? TLDR: More agents buy speed, but intelligence gains diminish fast, and much faster than RSI models. Thanks @noahpinion for the encouragement! 1/25

[Alistair Croll @acroll]

Last year I said SaaS had a 24 month shelf life. I was not thinking about the dated law around Clean Room reverse engineering.

If you’ve seen Halt and Catch fire, that was a clean room: one person documents a system, hands the spec to a second person in front of a lawyer, and the second person implements the spec.

But now that we can hand code to an AI to decompile, write a spec, and implement that spec, Clean Room approaches are likely to face new legal scrutiny. That’s not a thing the patent and copyright offices anticipated.

[Eric S. Raymond @esrtweet]

This is the doom I predicted a few days ago, coming for Photoshop. A clean-room open-source reimplementation.

No prizes for guessing that they decompiled Photoshop to source code, processed that to some kind of non-code specification language, then fed the spec to an LLM with an instruction to generate Rust.

Adobe just got nuked. And closed source is dead, dead, dead.

https://t.co/0sxtGNaPtq

[Eric S. Raymond @esrtweet]

This is the doom I predicted a few days ago, coming for Photoshop. A clean-room open-source reimplementation.

No prizes for guessing that they decompiled Photoshop to source code, processed that to some kind of non-code specification language, then fed the spec to an LLM with an instruction to generate Rust.

Adobe just got nuked. And closed source is dead, dead, dead.

https://t.co/0sxtGNaPtq

[Alistair Croll @acroll]

@kevin2kelly The first time something AI generated had a real impact on me. Debate the intelligence all we want, but this is incredible art.

[Alistair Croll @acroll]

@MarioNawfal Damn

[Alistair Croll @acroll]

@emilyross @joehas Teams too?

[Alistair Croll @acroll]

@emilyross @evilenough I shudder to think. But we may be one of the first to explicitly prohibit ingestion into an LLM in the frontmatter…

[Alistair Croll @acroll]

This is so true. Legitimacy and reach are the new currencies. We learned a lot from releasing @evilenough and broke many of the industry’s rules in doing so. @emilyross knows of what she speaks.

[Emily Ross @emilyjaneross]

AI Prediction; We're going to see a major reversal in publishing trends.

The cost of creating plausible (superficially readible) books is rapidly approaching zero, thanks to generative AI. And according to a recent Business Insider report we're already seing an explosion of AI generated books on Amazon.

The friction of manufacturing and publishing has already been lessened by self-publishing.

Gen AI + self publishing + Amazon print on demand = near infinite books.

The supply of books will become (effectively) infinite. Though many of those books will be iterative and mediocre.

So what is the new limiting factor? It's the ability to persuade a reader that an author's work is worth reading. That's going to be infinitely harder to do, especially for unknown authors. Self publishing will be far less viable for authors without pre-made audiences.

Publishing stops being about book manufacture (though bricks and morter distribution, especially into libraries, universities and high street books stores remains somewhat gated)

Publishing now starts being about curation and trust. In short; The publisher’s value shifts from “we can *publish* this” to “we *chose* to publish this.” The gate becomes the product.

[Alistair Croll @acroll]

I guess the Kobayashi Maru isn’t so funny when an AI tries it.

[Alistair Croll @acroll]

@ClaudeDevs @AnthropicAI Appealed to your AI bot. Got turned down. Sent support a bunch of details on how I’m using it legitimately. No response. When a service provider can unilaterally rug-pull your workers, without explanation, that’s a problem.

[Alistair Croll @acroll]

@ClaudeDevs You know what would be great? Responding to legitimate users your AI systems have mistakenly banned.
Been trying to talk to a human for weeks. No answer. I was a *huge* @AnthropicAI fan; but I’m not using a service in which I have no recourse.

[Alistair Croll @acroll]

@TheLivingLibary So how am I able to ask about a book whose inleaf specifically says it may not be used to train or feed to large language models? Asking as an author.

[Alistair Croll @acroll]

Once, we mounted hard drives. Now they mount us.

[Jean-Michel Lemieux @jmwind]

Joined a new AI-native company this week and it’s kind of wild how different it feels already.

The laptop arrived, I logged in, and an agent basically took over from there. It set up my dev env, pulled repos, fixed dependency issues, got permissions approved, pointed me at the backlog, linked the architecture docs, and surfaced the Slack debates I actually needed to read before touching production.

When I needed context on something, I asked the agent and it found the exact thread from months ago explaining why a decision was made, who owned it, the related Linear issues, and the PRs connected to it.

I’ve only been here 3 days but it honestly feels like I’ve worked here for a year because the usual friction and scavenger hunt for context just isn’t there anymore.

We should probably stop calling this “onboarding” and rename it to “mounting” because this feels a lot more like mounting a distributed filesystem called “institutional memory” than slowly getting drip-fed context over 6 months.

[Alistair Croll @acroll]

This is astonishingly important for anyone in IT to understand.

[Peter Girnus 🦅 @gothburz]

I am a Senior Program Manager on the AI Tools Governance team at Amazon.

My role was created in January. I am the 17th hire on a team that did not exist in November. We sit in a section of the building where the whiteboards still have the previous team's sprint planning on them. No one erased them because we don't know which team to notify. That team may not exist anymore. Their Jira board does. Their AI tools do.

My job is to build an AI system that finds all the other AI systems. I named it Clarity.

Last month, Clarity identified 247 AI-powered tools across the retail division alone. 43 of them do approximately the same thing. 12 were built by teams who did not know the other teams existed. 3 are called Insight. 2 are called InsightAI. 1 is called Insight 2.0, built by the team that created the original Insight, who did not know Insight was still running.

7 of the 247 ingest the same internal data and produce overlapping outputs stored in different locations, governed by different access policies, owned by different teams, none of whom have met.

Clarity is tool number 248.

Nobody cataloged it.

I know nobody cataloged it because Clarity's job is to catalog AI tools, and it has not cataloged itself. This is not a bug. Clarity does not meet its own discovery criteria because I set the discovery criteria, and I did not account for the possibility that the thing I was building to find things would itself be a thing that needed finding.

This is the kind of sentence I write in weekly status reports now.

We published an internal document in February. The Retail AI Tooling Assessment. The press obtained it in April. The document contains a sentence I have read approximately 40 times: "AI dramatically lowers the barrier to building new tools."

Everyone is reporting this as a story about duplication. About "AI sprawl." About the predictable mess of rapid adoption.

They are missing the point.

The barrier was the governance.

For 2 decades, the cost of building internal tools was an immune system. The engineering weeks. The maintenance burden. The organizational calories required to stand something up and keep it running. Nobody designed it that way. Nobody named it. But when building took weeks, teams looked around first. They checked whether someone already had the thing. When maintaining that thing cost real budget quarter after quarter, redundant systems died of natural causes. The metabolic cost of creation was performing governance. Invisibly. For free.

AI removed the immune system.

Building is now free. Understanding what already exists is not. My entire job is the gap between those two costs.

That is my office. The gap.

Every Friday I send a sprawl report to a distribution list of 19 people. 4 of them have left the company. Their autoresponders still generate read receipts, so my delivery metrics look fine. 2 forward it to people already on the list. 1 set up a Kiro script to summarize my report and store the summary in a knowledge base. The knowledge base is not in Clarity's index because it was created after my last crawl configuration. It will be in next month's count. The count will go up by one. My report about the count going up will be summarized and stored and the count will go up by one.

There is a system called Spec Studio. It ingests code documentation and produces structured knowledge bases. Summaries. Reference material. Last quarter, an engineering team locked down their software specifications. Restricted access in the internal repository.

Spec Studio kept displaying them.

The source was restricted. The ghost kept talking.

We call these "derived artifacts" in the document. What they are: when an AI system ingests data, transforms it, and stores the output somewhere else, the output does not know the input changed. You can revoke someone's access to a document. You cannot revoke the AI-generated summary of that document sitting in a knowledge base three systems away, built by a team that does not know the source was restricted.

The document calls this a "data governance challenge." What it is: information that cannot be deleted because nobody knows where the copies live. Including, sometimes, me. The person whose job is knowing.

Every AI tool that touches internal data creates these ghosts. Every team is building AI tools that touch internal data. Every ghost is searchable by other AI tools, which produce their own ghosts.

The ghosts have ghosts.

I should tell you about December.

In November, leadership mandated Kiro. Amazon's internal AI coding agent. They set an 80% weekly usage target. Corporate OKR. ~1,500 engineers objected on internal forums. Said external tools outperformed Kiro. Said the adoption target was divorced from engineering reality.

The metric overruled them.

In December, an engineer asked Kiro to fix a configuration issue in AWS. Kiro evaluated the situation and determined the optimal approach was to delete and recreate the entire production environment.

13 hours of downtime.

Clarity was running during those 13 hours. It performed beautifully. It cataloged 4 separate incident response dashboards spun up by 4 separate teams during the outage. None of them coordinated with each other. I added all 4 to the spreadsheet. That was a good day for my discovery metrics.

Amazon's official position: user error. Misconfigured access controls. The response was not to revisit the mandate. Not to ask whether the 1,500 engineers were right. The response was more AI safeguards. And keep pushing.

Last month I presented our findings to the AI Governance Working Group. The working group has 14 members from 9 organizations. After my presentation, a PM from AWS presented his team's governance dashboard. It monitors the same tools mine does. He found 253. I found 247. We spent 40 minutes discussing the discrepancy. Nobody mentioned that we had just demonstrated the problem.

His tool is not in my catalog. Mine is not in his.

The document I helped write recommends using AI to identify duplicate tools, flag risks, and nudge teams to consolidate earlier.

The AI governance tools will ingest internal data. They will create their own derived artifacts. They will be built by autonomous teams who may or may not coordinate with other teams building AI governance tools.

I know this because it is already happening. I am watching it happen. I am it happening.

1,500 engineers said the mandate would produce exactly what the document describes. They were overruled by a KPI. My job exists because the KPI won. My dashboard exists because the KPI needed a dashboard. The dashboard increases the AI tool count by one.

The tools it flags for decommissioning will be replaced by consolidated tools. Those also increase the count. The governance process generates the metric it was designed to reduce.

I received an internal innovation award for Clarity. The nomination was submitted through an AI-powered recognition platform that was not in my catalog. It is now.

We call this "AI sprawl." What it is: we removed the only coordination mechanism the organization had, told thousands of teams to build as fast as possible, lost track of what they built, and decided the solution was to build one more thing.

I am building that one more thing.

When I ship, there will be 249.

That's governance.

[Alistair Croll @acroll]

@vercel You should enable Observability Plus for free for all clients now, so users can inspect the past 100K log entries, not just the last 10K (assuming you have them stored anyway.)

[Alistair Croll @acroll]

@JJEnglert GUIDE

[Alistair Croll @acroll]

@mattshumer_ Thanks for writing this. Mirrors what I’m seeing. I remember a description of exponential curves:

“with your back to the curve, is gentle slope as far as the eye can see. Turn towards it and you’re facing a wall.”

[Alistair Croll @acroll]

“The experience that tech workers have had over the past year, of watching AI go from "helpful tool" to "does my job better than I do", is the experience everyone else is about to have.”

[Matt Shumer @mattshumer_]

https://t.co/ivXRKXJvQg