This is what product engineers mean when they say “delightful experiences”
To be surprised with something beautiful, tactile, or rewarding where usually you expect something dull (a poring over a verbose chatbot response on technical details)
NVIDIA just released a new open source transcription model, Nemotron Speech ASR, designed from the ground up for low-latency use cases like voice agents.
Here's a voice agent built with this new model. 24ms transcription finalization and total voice-to-voice inference time under 500ms.
This agent actually uses *three* NVIDIA open source models:
- Nemotron Speech ASR
- Nemotron 3 Nano 30GB in a 4-bit quant (released in December)
- A preview checkpoint of the upcoming Magpie text-to-speech model
These models are all truly open source: weights, training data, training code, and inference code. This is a big deal! Jensen said in the CES keynote yesterday that he expects open source models to catch up to proprietary models this year in a number of categories. NVIDIA is putting their weight behind making this happen. (As Alan Kay said, the best way to predict the future is to invent it.)
The code for this agent is open source too, of course. You can deploy it to production with @modal and @pipecat_ai cloud, or run locally on an @nvidia DGX Spark or RTX 5090.
@SuhailKakar Asking for explanations and just chatting about the coming code changes also grounds the chat thread in reasoned, understanding context! Super helpful for scoping, and better outputs
Similar to the “take this step by step” hack from back in the day, but more steered
@HayagrivS@akoratana We don’t have agi yet so the artifact is still useful to steer agents through the nuances of the deployment environment for now.
But I agree that if we had a ton of validated, well indexed traces, then that would great rl data to get better reasoning into the weights