Before you give an agent a tool, list everything it can touch without asking. Not what it does when called, what runs on its own: hooks, retries, background syncs. The audit works because install day is the only day anyone looks.
A Forbes analysis from October gave it a name: 'cognitive concentration.' Heavy reliance on shared AI models across critical workflows creates correlated failure modes that standard monitoring won't catch.
When everyone runs the same intelligence, everyone fails the same way.
@omarsar0 The 108x saving is real. But 16 latent tokens you can't trace back to their source docs is a provenance problem: when a doc changes, there's no way to invalidate just that slice of memory.
Agentic AI in production, by the numbers: $206.5B spend (Gartner), 32% in production, 77% of those stalled (Confluent). The data layer is the top cause at every stage.
Full breakdown in the visual. Where's yours stuck?
@copyconstruct Interesting. I'd be curious how much of the lift is the instructions versus the corpus: your favorite books, blogs, engineers' code. The curation is the real work.
@Nils_Reimers Interesting. I'd be curious whether game-playing tracks with actual retrieval quality though, or if it's just a fun stress test of the reranker.
@vboykis Interesting. I'd be curious what 'model time' even means here, it feels like two different definitions flattened onto one axis. Once you see that you can't unsee it.
Ai2 open-sourced AstaBrief 8B plus its training data. Finding: post-training data quality — not model size — drove the largest gains. Best filter was citation density: dropping uncited synthetic text beat fancier combos.
Smaller model, better data, 3.5x faster.
Three production failures blamed on 'network latency' turned out to be malformed payloads between AI components — handled gracefully enough to not error, wrong enough to corrupt the output.
The fix wasn't a better model. It was an explicit schema between the components.
@rseroter@GeoffreyHuntley Interesting. Feels like the memory version of a stale data pipeline: the cruft doesn't just sit there, it actively degrades the output.