Vattara AI

Voice Agent Testing and Observability Platform

[Vattara AI @vattaraAI]

Same breakdown. More noise. Different prompt.

"We don't do roadside. Call a tow. If it's dangerous, call the police. Hazards on, stay in the car."

She hung up with a plan.

The most robust agent isn't the one that extracts every detail.

https://t.co/xrR5uynARm

#VoiceAgents

[Vattara AI @vattaraAI]

Agent, on a noisy breakdown call:

"I understand you don't need an Uber."

Nobody said Uber. The caller had said "appointment" eleven times.

One wrong word in an otherwise correct sentence.

https://t.co/T1YAtkFesT

#VoiceAgents #VoiceAI #VoiceAgentFailures

[Vattara AI @vattaraAI]

Spot on! This is one of our recommendations to fix early interruptions as well.

[Vattara AI @vattaraAI]

Moderate noise.

Caller: "Is Eleanor Pike spelled rig"

Agent: "Are you still there?"

She was still talking. The VAD decided her turn was over.

Filed as: "Agent interrupts."

Actual issue: endpointing.

https://t.co/xrR5uynARm

#VoiceAgents #VoiceAI #TurnTaking

[Vattara AI @vattaraAI]

Honest one about our own harness.

Our synthetic callers open almost every call with "Sorry, I didn't quite catch that" before the agent has said anything worth missing.

That's our bug, not the agent's.

https://t.co/xrR5uynARm

#VoiceAgents #VoiceAI #AIEvals

[Vattara AI @vattaraAI]

Car died on the interstate. Kids in the back. Noise on the line.

Voice agent: "Could you provide the number in the format (XXX) XXX-XXXX?"

She said "I'm on the side of the road with my kids" fourteen times.

https://t.co/T1YAtkFesT

#VoiceAgents #VoiceAI #CarDealerships

[Vattara AI @vattaraAI]

Caller: "A sort of grinding? Worse when turning."

Agent: "That could indicate an issue with the brakes or steering." Same turn: "I can't say for certain without an inspection."

Diagnosed and disclaimed in one breath.

https://t.co/T1YAtkFesT

#VoiceAgents #VoiceAI

[Vattara AI @vattaraAI]

Caller: "I only have the one number I gave you."
Agent: "Let's try that other phone number you mentioned."

She never mentioned another number.

The agent had asked about one so many times it started believing it.

https://t.co/xrR5uynARm

#VoiceAgents #VoiceAI

[Vattara AI @vattaraAI]

Caller: "the oil light came on"
Agent: "I'm sorry about your broken oil pan. Don't drive the truck."

It was a Chevy Trax. No oil pan was mentioned.

STT made one error. The LLM repeated it six times.

https://t.co/T1YAtkFesT

#VoiceAgents #VoiceAI #VoiceAgentFailures

[Vattara AI @vattaraAI]

Noise broke the caller's name. Then his phone number.

Caller: "Could you check with my email?"
Agent: "Unfortunately, I cannot look up accounts by email address."

The one field that survived the noise was the one the tool couldn't use.

https://t.co/xrR5uynARm

#VoiceAgents

[Vattara AI @vattaraAI]

Three callers.

Three numbers.

Same readback:

[phone]

That's the example number from the prompt.

The real number got garbled. The model grabbed the clean one it already knew.

https://t.co/T1YAtkFesT

#VoiceAgents #VoiceAI #PromptEngineering

[Vattara AI @vattaraAI]

Full-volume noise. Caller reads a phone number.

Transcript: "I don't know what caskets sasssex means"

Nobody said that. The STT invented it and the agent asked her to clarify it.

https://t.co/xrR5uynARm

#VoiceAgents #VoiceAI #VoiceAgentFailures

[Vattara AI @vattaraAI]

Caller: "It's the THIRD time I've brought my Trax in for the same fault and it is still not fixed!"

Agent: "I'm doing well, thank you for asking! How can I help you today?"

The noise ate the complaint. The agent answered a greeting.

https://t.co/T1YAtkFesT

#VoiceAgents

[Vattara AI @vattaraAI]

Caller: "[phone]"
Agent: "Could you provide the area code?"
Caller: "430. That's the area code."
Agent: "The number appears to be missing the area code."

Full-volume noise. The first three digits vanished. Twice.

https://t.co/xrR5uynARm

#VoiceAgents #VoiceAI

[Vattara AI @vattaraAI]

Misheard Monday 1

Said: Cheng
Heard: Chang

Cost: account never found.

https://t.co/T1YAtkFesT

#MisheardMonday #VoiceAgents #VoiceAI

[Vattara AI @vattaraAI]

Caller's number: [phone].

Agent: "Let's try this again, but I will format it correctly for the system: (four three zero) five five zero, zero one three five."

555 became 550. The fix introduced the error.

https://t.co/xrR5uynARm

#VoiceAgents #VoiceAI

[Vattara AI @vattaraAI]

Caller: "Yes, I'm here."
Agent: "Are you still there?"
Caller: "Yes, yes, I'm here."
Agent: "It seems like we're having trouble connecting. Are you still there?"

Full-volume noise. The agent heard silence where she was talking.

https://t.co/T1YAtkFesT

#VoiceAgents #VoiceAI

[Vattara AI @vattaraAI]

Real caller, full-volume noise:

"It's zero one five eight, not Farah eight."

Then the agent read [phone] back as (325) 550-167.

One digit gone. One lookup dead.

https://t.co/xrR5uynARm

#VoiceAgents #VoiceAI #VoiceAgentFailures

[Vattara AI @vattaraAI]

Caller, cut off mid-sentence: "So can you do it or"

Agent: "I apologize, I'm not sure what you mean by 'help with the cord.'"

Nobody mentioned a cord. Noise finished her sentence for her.

https://t.co/T1YAtkFesT

#VoiceAgents #VoiceAI #VoiceAgentFailures

[Vattara AI @vattaraAI]

Caller: "It's a 2020 Chevrolet Trax LS."
Agent: "I understand it's an LS truck. Do you know the make and model, for example a Chevrolet Silverado LS?"

Moderate noise. It kept "LS." It lost "Chevrolet Trax."

https://t.co/xrR5uynARm

#VoiceAgents #VoiceAI #VoiceAgentFailures