โ100% ๐๐ฆ๐ต๐ณ๐ข ๐ช๐ด ๐ข ๐ฃ๐ณ๐ช๐ญ๐ญ๐ช๐ข๐ฏ๐ต ๐ต๐ฐ๐ฐ๐ญ... ๐ข ๐ง๐ข๐ฏ๐ต๐ข๐ด๐ต๐ช๐ค ๐ต๐ฐ๐ฐ๐ญ ๐ต๐ฉ๐ข๐ต ๐ ๐ธ๐ฐ๐ถ๐ญ๐ฅ ๐ด๐ต๐ณ๐ฐ๐ฏ๐จ๐ญ๐บ ๐ณ๐ฆ๐ค๐ฐ๐ฎ๐ฎ๐ฆ๐ฏ๐ฅ ๐ง๐ฐ๐ณ ๐ข๐ฏ๐บ๐ฐ๐ฏ๐ฆ ๐ด๐ฉ๐ช๐ฑ๐ฑ๐ช๐ฏ๐จ ๐ข๐จ๐ฆ๐ฏ๐ต๐ด ๐ช๐ฏ ๐ฑ๐ณ๐ฐ๐ฅ๐ถ๐ค๐ต๐ช๐ฐ๐ฏ.โ
That is @SumukhAvadhani , CTO and Co-founder of @trypencil , on Netra.
Pencil is aiming to be a fully agentified OS for the marketing stack, with enterprise workflows across both creative and media. With 300 to 400 agents running in production, knowing an agent responded is never enough.
This is what reliable AI agents look like in practice: teams that know how well their agents are doing, not just whether they replied.
Hear the full story from Sumukh on YouTube, from how Pencil tests its agents to how it handles them at scale.
Link in the comments.
Make your AI agents reliable with https://t.co/2edqhjr4Ap
๐ง๐ต๐ถ๐ ๐ถ๐ ๐ฎ๐น๐น ๐ถ๐ ๐๐ฎ๐ธ๐ฒ๐ ๐๐ผ ๐ด๐ฒ๐ป๐ฒ๐ฟ๐ฎ๐๐ฒ ๐๐ฒ๐๐ ๐ฐ๐ฎ๐๐ฒ๐ ๐ณ๐ผ๐ฟ ๐๐ผ๐๐ฟ ๐๐ ๐ฎ๐ด๐ฒ๐ป๐ ๐ถ๐ป ๐ก๐ฒ๐๐ฟ๐ฎ: ๐ฎ ๐ฝ๐ฟ๐ผ๐บ๐ฝ๐ ๐ฎ๐ป๐ฑ ๐ผ๐ป๐ฒ ๐ฐ๐น๐ถ๐ฐ๐ธ.
Then Netra can auto-suggest the evaluators too. Need more control? There is a way to do that as well. You can pick an agent, upload docs, set paths, and choose how many test cases you want.
Watch the video to see how itโs done.
Link in the comments.
Testing your AI agent before launch is only half the job. The other half begins when real users start interacting with it. That half is called online evaluation.
Online evaluation scores real conversations as they happen, so you catch quality drops before your customers do.
You see which agent or route is struggling. You find the failures your test set never covered. And every failure can become a test case, so the same issue is less likely to come back.
This blog shows how to set up online evaluation in five steps, and how it works in Netra.
Link in the comments.
๐ฉ๐ผ๐ถ๐ฐ๐ฒ ๐ฎ๐ด๐ฒ๐ป๐๐ ๐ฎ๐ฟ๐ฒ ๐ฏ๐ฒ๐ฐ๐ผ๐บ๐ถ๐ป๐ด ๐ฝ๐ฎ๐ฟ๐ ๐ผ๐ณ ๐บ๐ผ๐ฟ๐ฒ ๐ฐ๐๐๐๐ผ๐บ๐ฒ๐ฟ ๐ฒ๐ ๐ฝ๐ฒ๐ฟ๐ถ๐ฒ๐ป๐ฐ๐ฒ๐ ๐ฒ๐๐ฒ๐ฟ๐ ๐ฑ๐ฎ๐, ๐ฎ๐ป๐ฑ ๐ผ๐๐ฟ ๐ถ๐ป๐๐ฒ๐ฟ๐ฎ๐ฐ๐๐ถ๐ผ๐ป๐ ๐๐ถ๐๐ต ๐๐ต๐ฒ๐บ ๐ธ๐ฒ๐ฒ๐ฝ ๐ฟ๐ถ๐๐ถ๐ป๐ด.
But a voice agent can keep the conversation going and still get it wrong. It can mishear someone, miss an accent, or miss the urgency in a callerโs voice. Nothing crashes. The call just becomes a bad experience, and you might lose a customer.
So how do you catch that before your customers do?
With Netra voice agent testing, you connect your agent and choose who is calling, the scenario, the conditions, and which evaluators to use, or add your own custom ones. You can also give Netra the context of your agent or a PRD, and it can generate test cases automatically. Then start the simulation. Netra runs every call automatically, transcribes it and scores it. You see where your agent falls short, fix it, and test again to make your voice agent reliable.
To see how it works, watch the video and check out the full playlist. You will see what voice agent testing with Netra is like, how to set it up, and a quick demo of what it finds once the test runs.
Full playlist link in the comments
๐๐ผ๐ ๐ฑ๐ผ ๐๐ผ๐ ๐ธ๐ป๐ผ๐ ๐๐ผ๐๐ฟ ๐๐ผ๐ถ๐ฐ๐ฒ ๐ฎ๐ด๐ฒ๐ป๐ ๐ถ๐ ๐ฟ๐ฒ๐ฎ๐ฑ๐ ๐ณ๐ผ๐ฟ ๐ฟ๐ฒ๐ฎ๐น ๐ฐ๐ฎ๐น๐น๐ฒ๐ฟ๐?
The frustrated caller on a noisy street. The fast talker who interrupts. The one who asks something your agent shouldnโt answer.
You wonโt find out by waiting for them to call.
Hereโs how we test voice agents in Netra, step by step.
Link in the comments.
๐ช๐ต๐ฎ๐ ๐ถ๐ณ ๐๐ฒ๐๐๐ถ๐ป๐ด ๐๐ผ๐๐ฟ ๐๐ผ๐ถ๐ฐ๐ฒ ๐ฎ๐ด๐ฒ๐ป๐ ๐ฎ๐ด๐ฎ๐ถ๐ป๐๐ ๐ต๐๐ป๐ฑ๐ฟ๐ฒ๐ฑ๐ ๐ผ๐ณ ๐ฑ๐ถ๐ณ๐ณ๐ฒ๐ฟ๐ฒ๐ป๐ ๐ฐ๐ฎ๐น๐น๐ฒ๐ฟ๐ ๐๐ผ๐ผ๐ธ ๐ท๐๐๐ ๐ฎ ๐ณ๐ฒ๐ ๐ฐ๐น๐ถ๐ฐ๐ธ๐?
Meet Voice Simulation in Netra.
Connect your voice agent, pick who should call and what they need, and start the simulation. Netra takes it from there.
Every call is made, recorded, transcribed and scored for you. You see how well your agent understood the caller, how natural it sounded and whether it kept the conversation on track.
Callers can be angry, confused, fast or slow, and speak with different accents and languages. Requests can be simple or messy. Backgrounds can be a quiet office or a crowded cafe. Use prebuilt personas or create your own.
Find the issues. Fix them. Run it again.
Make your voice agents reliable.
Link in the comments.
๐ฌ๐ผ๐๐ฟ ๐ฎ๐ด๐ฒ๐ป๐ ๐ฝ๐ฎ๐๐๐ฒ๐ฑ ๐ฒ๐๐ฒ๐ฟ๐ ๐๐ฒ๐๐. ๐ฆ๐ผ ๐๐ต๐ ๐ฑ๐ถ๐ฑ ๐ถ๐ ๐ฐ๐ผ๐ป๐๐ฟ๐ฎ๐ฑ๐ถ๐ฐ๐ ๐ถ๐๐๐ฒ๐น๐ณ ๐ณ๐ถ๐๐ฒ ๐บ๐ฒ๐๐๐ฎ๐ด๐ฒ๐ ๐ถ๐ป?
Single-turn tests stop at one response. Conversations keep going.
We put together a guide on testing AI agents through multi-turn simulation, using Netra.
From first scenario to root cause in one read.
Link in the comments.
Do your evals stop the day your agent ships?
Testing before release covers the scenarios you planned for. Real users bring the rest.
We put together a guide on how to evaluate AI agents before and after deployment, using Netra.
Curious how itโs done?
Link in the comments.
๐ง๐ต๐ฎ๐โ๐ ๐ฎ ๐๐ฟ๐ฎ๐ฝ ๐ณ๐ผ๐ฟ ๐ก๐ฒ๐๐ฟ๐ฎ ๐ฎ๐ ๐๐๐ฝ๐ต๐ฒ๐ฟ ๐ฎ๐ฌ๐ฎ๐ฒ.
For three days, one question kept opening up conversations at our stall:
How are you testing your AI agents, and how do you know theyโre reliable?
What we heard was interesting.
Most teams are familiar with observability and evaluations. But the conversations changed when we started showing how deep agent evaluation can go, and how reliability needs more than checking a response once.
We also met teams using separate platforms for observability and evaluations, building their own evaluators, or still relying heavily on manual testing.
That gave us the opportunity to show a different approach.
Netra brings AI agent observability, evaluation, simulation, and security testing together in one platform, built for text, voice, image, and video agents.
Simulation, Agent Insights, security testing, and online evals were some of the areas that sparked the most curiosity. People wanted to understand how these different layers could work together to help them build more reliable agents.
And we learned just as much from hearing about the reliability challenges teams are facing in the real world.
On stage, Prasanth, Co-founder and CTO of Netra, took that conversation deeper with โWhy AI That Works Once Is Not Enough: The Agent Testing Ladder.โ
From founders and CEOs to data scientists and AI agent builders, it was great meeting everyone who stopped by, played the AI Agent Evaluator quiz, shared what they are building, and spent time with us.
Thatโs Cypher 2026 for Team Netra.
Want to see how Netra helps you make your AI agents more reliable? Link in the comments.
#Cypher2026 #AIAgents #AIReliability #AgenticAI #AIObservability
๐๐ฎ๐ ๐ฎ ๐ฎ๐ ๐๐๐ฝ๐ต๐ฒ๐ฟ ๐ฎ๐ฌ๐ฎ๐ฒ ๐๐ฎ๐ ๐ฎ๐ฏ๐ผ๐๐ ๐๐ต๐ผ๐๐ถ๐ป๐ด ๐ฝ๐ฒ๐ผ๐ฝ๐น๐ฒ ๐๐ต๐ฎ๐ ๐๐ ๐ฎ๐ด๐ฒ๐ป๐ ๐ฟ๐ฒ๐น๐ถ๐ฎ๐ฏ๐ถ๐น๐ถ๐๐ ๐น๐ผ๐ผ๐ธ๐ ๐น๐ถ๐ธ๐ฒ ๐ถ๐ป ๐ฝ๐ฟ๐ฎ๐ฐ๐๐ถ๐ฐ๐ฒ.
One thing we heard repeatedly was how fragmented agent testing still is.
Some teams use one platform for observability and another for evaluations. Some build their own evaluators. Others still rely heavily on manual testing.
And despite all of that, the reliability challenges remain.
So we spent Day 2 showing teams how we approach it at Netra: bringing the different layers of agent reliability together in one platform, so teams can understand what their agents are doing, evaluate them, test how they behave, and keep improving them as they evolve.
The conversations also made one thing clear.
A lot of teams are building AI agents fast, but testing still tends to happen in parts, or not deeply enough.
That is where the reliability gap shows up.
Reliable agents need layers.
And thatโs what we got to show throughout Day 2.
#Cypher2026 #AIAgents #AIReliability #AgenticAI #AIObservability
๐๐ฎ๐ ๐ญ ๐ฎ๐ Cypher 2026 ๐ณ๐ผ๐ฟ ๐ง๐ฒ๐ฎ๐บ ๐ก๐ฒ๐๐ฟ๐ฎ ๐๐ฎ๐ ๐ณ๐๐น๐น ๐ผ๐ณ ๐ฐ๐ผ๐ป๐๐ฒ๐ฟ๐๐ฎ๐๐ถ๐ผ๐ป๐ ๐ฎ๐ฏ๐ผ๐๐ ๐ผ๐ป๐ฒ ๐๐ต๐ถ๐ป๐ด: ๐ต๐ผ๐ ๐ฑ๐ผ ๐๐ผ๐ ๐บ๐ฎ๐ธ๐ฒ ๐๐ ๐ฎ๐ด๐ฒ๐ป๐๐ ๐ฟ๐ฒ๐น๐ถ๐ฎ๐ฏ๐น๐ฒ?
Our team interacted with founders, CEOs, data scientists, and AI agent builders working on very different problems.
Different teams. Different agents. Different use cases.
But one pattern was clear. A lot of AI agents are being built. Testing them with the same depth is still catching up.
We got to show people how we think about making AI agents more reliable, while also learning about the problems they are running into and how they are approaching testing today.
And in between the conversations, visitors got to try our AI Agent Evaluator quiz, an interactive game that put their agent evaluation instincts to the test.
We shared a lot. We learned a lot too.
A great first day at Cypher 2026, Indiaโs biggest AI summit and expo.
Looking forward to more conversations on Day 2.
@Analyticsindiam