Today we're launching Agent Analytics
Every team shipping an AI agent has the same blind spot. Offline evals pass, you ship, and then you have no idea what's happening in production. AI fails silently. Users ask a question and get different answers. They all look 'engaged' in a classic dashboard. You don't know who got a great response and who got a terrible one.
Agent Analytics solves it:
- Every session scored out of the box on task completion, response quality, friction, safety, and negative feedback
- Topic clustering across thousands of conversations, so you know if a failure hits 1 user or 10,000
- Eval agents that watch for regressions, and if you want will file a Linear ticket or the pull request themselves
- Agent quality sits next to product data, so 'payment scheduling fails 31%' becomes 'which renewals did that cost us?'
The Economist got their agent to a 96.9% task success rate and cut weekly failures 84%.
Included on every plan. Free tier included. https://t.co/K5vqrlMLvd
We are releasing the world's first case study of self improving products at Amplitude. A lot of companies have talked about it but none have shown any examples. We have the holy grail of this space and can show it!
We've been running our self improving product engine, Wave, on top of Amplitude for the last few months. It's made lots of changes to our website and product based on analytics, session replay, and many other data sources. These have resulted in MASSIVE improvements in metrics on the order of 50% to 3x, not incremental ones.
These include:
- Personalized suggestion cards on a homepage led to a +160% increase in usage
- Improved doc search accuracy from 92% to 97% by setting a 3 character minimum
- Reducing setup checklist from five next steps to one guided first step, projected to improve onboarding completion from ~6% to ~9%.
- Adding a CTA to each blog post leading to 45 extra signups a week
We're slowly rolling Wave out to a few customers and will be sharing examples from them soon. Check it out here and sign up if you're interested in entering the closed beta:
This is a step change for all the future builders. Bringing analytics into the flow of work to let builders know they are building great things is amazing
Not only that, it let's non technical people use analytics. A great example... Me!
Al has collapsed the time it takes to ship a feature. Now it's all about shipping the right thing. It's just as hard as it ever was.
As coding gets automated, agentic analytics becomes the bottleneck. Teams that win will build within context rich environments that capture user behavior and customer feedback, making that data accessible to both builders and agents.
Today @Amplitude_HQ is launching our Al Analytics Platform with Agents and MCP. Autonomous analytics that helps builders and coding agents ship products that their customers actually want.
Just as our partner @claudeai has reinvented software, Amplitude is reinventing analytics for the Al age.
We have achieved 76% accuracy for complex production grade queries and agentic usage has grown 10x in 3 months.
Don't just build fast, build what's right.
Try it for free, today.
I've been using our global chat to explore usage and uncover any interesting tidbits to help tell the Amplitude story. Before I'd ping our data team with an idea. Now I query together with our agent to get to the second level and have an inspired conversation with the team
Al has collapsed the time it takes to ship a feature. Now it's all about shipping the right thing. It's just as hard as it ever was.
As coding gets automated, agentic analytics becomes the bottleneck. Teams that win will build within context rich environments that capture user behavior and customer feedback, making that data accessible to both builders and agents.
Today @Amplitude_HQ is launching our Al Analytics Platform with Agents and MCP. Autonomous analytics that helps builders and coding agents ship products that their customers actually want.
Just as our partner @claudeai has reinvented software, Amplitude is reinventing analytics for the Al age.
We have achieved 76% accuracy for complex production grade queries and agentic usage has grown 10x in 3 months.
Don't just build fast, build what's right.
Try it for free, today.
This is the future of analytics.
Ask Claude a question about user behavior, get an interactive chart response, change the chart within the chat, and then continue chatting with Claude.
Here's a demo:
Introducing the holy grail of AI Analytics: Automated Insights
We've built an AI that works like an expert analyst. It proactively queries your data to figure out what's causing a change. See it in action:
Don’t talk to users?
ngmi
Today’s launch of AI Feedback is personal.
It’s the culmination of my @Kraftful journey.
We built Kraftful to help teams truly listen to users.
Now we’re taking that mission even further at @Amplitude_HQ with AI Feedback.
AI can automate almost everything.
But it can’t replace how people *feel* when using your product.
For builders, listening to those emotions is how you create something exceptional.
Now you can do that right inside Amplitude.
Across surveys, support tickets, sales calls, app reviews, Reddit, Discord, X, G2, and more.
Connect your sources in minutes and start getting daily insights that used to take hundreds of thousands of hours to analyze manually.
Available on every Amplitude plan (even the free one!).
Go try it. Listen to your users. Build better.
We just made Amplitude's first free product.
Introducing AI Visibility: SEO for LLMs.
Customers are using search engines less and AI more for finding what companies they should work with.
AI Visibility queries @ChatGPTapp, @claudeai, and @GeminiApp, and scores how your company appears across hundreds of prompts. It shows competitor rankings, sentiment, and trends. It gives you recommendations on how you can improve your company's visibility. Ranking highly with LLMs is the biggest untapped opportunity in marketing.
@_leojiang shares more: