Today we're launching Agent Analytics
Every team shipping an AI agent has the same blind spot. Offline evals pass, you ship, and then you have no idea what's happening in production. AI fails silently. Users ask a question and get different answers. They all look 'engaged' in a classic dashboard. You don't know who got a great response and who got a terrible one.
Agent Analytics solves it:
- Every session scored out of the box on task completion, response quality, friction, safety, and negative feedback
- Topic clustering across thousands of conversations, so you know if a failure hits 1 user or 10,000
- Eval agents that watch for regressions, and if you want will file a Linear ticket or the pull request themselves
- Agent quality sits next to product data, so 'payment scheduling fails 31%' becomes 'which renewals did that cost us?'
The Economist got their agent to a 96.9% task success rate and cut weekly failures 84%.
Included on every plan. Free tier included. https://t.co/K5vqrlMLvd
That's why we built Agent Analytics, available today on every Amplitude plan. It scores every session automatically (task completion, friction, user safety) and clusters them by topic, so you can see exactly which failures are costing you a renewal. Stop shipping on vibes only.
Al has collapsed the time it takes to ship a feature. Now it's all about shipping the right thing. It's just as hard as it ever was.
As coding gets automated, agentic analytics becomes the bottleneck. Teams that win will build within context rich environments that capture user behavior and customer feedback, making that data accessible to both builders and agents.
Today @Amplitude_HQ is launching our Al Analytics Platform with Agents and MCP. Autonomous analytics that helps builders and coding agents ship products that their customers actually want.
Just as our partner @claudeai has reinvented software, Amplitude is reinventing analytics for the Al age.
We have achieved 76% accuracy for complex production grade queries and agentic usage has grown 10x in 3 months.
Don't just build fast, build what's right.
Try it for free, today.
Is there a name for this UI pattern, where it "stacks" as you go through nested elements? This example is from https://t.co/NLLbyNadAa. I'm hoping someone out there has some code editor that can do this 👀