Our team can't stop talking about the World Cup—so @martschweiger pointed our newest model, Universal-3.5 Pro, at a bilingual Cristiano Ronaldo interview to see how it handles the parts most models fumble.
He switches between Portuguese and English mid-sentence. Universal-3.5 Pro transcribes both, natively.
Then we pasted the YouTube description in as context, and it caught his Portuguese nickname "Cris," the interviewers' TV stations, and the club he was talking about.
The same is true for the domains this model is built for: clinical documentation, contact center calls, and meeting recordings.
See Universal-3.5 Pro in action👇
Universal-3.5 Pro Async is here — native code-switching across 18 languages, our best speaker diarization yet, and contextual prompting. All at $0.21/hr.
Learn more: https://t.co/AiO0VDrJtk
Ordering a prescription by voice leaves no room for "close enough." Drug names, dosages, patient details—every word has to land.
@stefanjblos built a voice agent that does exactly that—and gets the messy, high-stakes language of medicine.
💊Building agents that work with medical data is incredibly hard. There's a lot of very specific terms and names + very sensitive data + a high-risk environment.
Our resident DevRel @stefanjblos build a prescription ordering agent that is incredible at understanding and navigating this complex terrain. Using @AssemblyAI's incredible new Universal 3.5 Pro model with its medical capabilities, @GoogleDeepMind's fast and accurate Gemini 3.5 Flash model and @inworld_ai's human-like, low-latency TTS the final result is incredible.
Check it out below, and watch out for the blog post that's coming soon!
Clicky by @FarzaTV is powered by @AssemblyAI Universal 3 Pro streaming model. I cloned it and upgraded it to Universal 3.5 to show how our newest realtime model can actively listen with context.
The page itself becomes context for the speech model.
As you scroll, Clicky updates Universal 3.5 with key terms from the screen so it can accurately recognize technical jargon, APIs, code, and other terms that speech models typically struggle to transcribe. Instead of guessing, the model already knows what to listen for.
Until today, a transcription model never knew what your voice agent just asked.
The one we're launching today does.
Universal-3.5 Pro Realtime from AssemblyAI is the first realtime speech-to-text model that takes your agent's side of the conversation as context.
When your agent asks for an email and the caller rattles it off, the model already knows an email is coming, and captures it perfectly. Same for an order number read fast, an account ID, a medication, or a name spelled out over poor quality phone line.
Watch the video below for a full demo of how amazing our new Universal-3.5 Pro Realtime model is. Live, real demos always beat generic benchmarks!
Available today in our API, Playground, and partner integrations.
You can call a phone number and ask an AI to find you the perfect vinyl based on a mood or memory.
We're kicking off our weekly Voice Agent Spotlight with The Record Store Oracle, built by @Gyurmatag, and honestly, the personality in this one sets the bar.
Speak a feeling. An era. A specific road trip. The agent listens, thinks, and recommends a record.
Under the hood it's a surprisingly clean stack:
→ @AssemblyAI Voice Agent API (STT + LLM + TTS in one)
→ @Twilio Media Streams for real phone call handling
→ @Cloudflare Workers + Durable Objects for hosting
→ Single WebSocket, no transcoding overhead
The UI contains a live orb that pulses as the agent thinks, with a real-time transcript of tool calls happening beneath the surface.
New project every Wednesday. More builders, more stacks, more ideas for what voice AI can actually do.
🎙️Demo The Record Store Oracle: https://t.co/y4CneOVeGM
🏆Full showcase: https://t.co/dJcwo0NUZK
AI medical voice agent in production.
- 14 hours of call volume
- 38 appointments booked, more captured revenue for practices
- 11 appointments cancelled -> reduces no show rate and saves cost on valuable chair time
Thx @livekit@cartesia@rimelabs@AssemblyAI
This Wednesday afternoon you could have a working voice agent you built yourself.
@dan_aai from @AssemblyAI is running a live workshop. Claude Code + AssemblyAI Voice Agent API, built from scratch in about an hour. 🤖
Claude Code does the building. You direct it. No coding experience required.
Starter code to fork. Q&A the whole way through. free.
Jun 10. 10AM PT. → https://t.co/o4Zi4xS0Ym