sindarin.

Fast voice AI agents that actually work. Get started at

[sindarin. @SindarinTech]

Speak to our state of the art conversational speech AI right here in your browser:

https://t.co/g6E2tBLMAF

[sindarin. @SindarinTech]

Thinking about rebranding to TurboClankers, Incoporated

[Brian Atwood @batwood011]

Everyone underestimates how hard low latency voice AI is.

Everyone.

[Kai Brokering @kai_brokering]

@batwood011 Yeah, sindarin had the fastest turn taking over year ago but people only knew about Vapi and Vocode

[sindarin. @SindarinTech]

Good things can happen when you take inspiration from neuroscience!

[Shruti @heyshrutimishra]

This paper didn’t go viral but it should have.

A tiny AI model called HRM just beat Claude 3.5 and Gemini.

It doesn’t even use tokens.

They said it was just a research preview.

But it might be the first real shot at AGI.

Here’s what really happened and why OpenAI should be worried: 🧵

[Brian Atwood @batwood011]

We have built an absolutely killer context engineering platform for real-time voice agents at @SindarinTech.

DM me and I’d be happy to show it to you.

[Brian Atwood @batwood011]

Here's the thing about deploying truly low-latency, full-duplex, realtime speech products in the real world:

You only have a couple of hundred milliseconds to do *all of the work* that you need to do to prepare your response to the user.

Most products that implement sophisticated text-based chat agents today do all sorts of RAG; auxiliary LLM calls; API calls; and so on after their user hits "send" and before generating a final response.

You cannot do it that way for realtime speech. For all practical purposes, you will *never* be able to do it that way for realtime speech.

You are battling the speed of light and RDBMS r/w speeds with every API call.

You are battling LLM TTFT and ITL - which can't fit the latency criteria even using a 7b on an 8xB200 today - with every secondary LLM call.

So the architecture of a realtime, full-duplex speech product needs to be fundamentally different.

You need new models and new infrastructure that can make speech products useful while still being lightning-fast.

That's what we've built at @SindarinTech.

[Brian Atwood @batwood011]

When you speak with the Persona on our landing page at https://t.co/yIli8nWoya, we immediately get a summary in a Slack channel that looks like this.

If you say something hilarious, I'll post it here.

[sindarin. @SindarinTech]

We released one of our first demos, https://t.co/Lsvsy1nP4I, nearly two years ago.

Someone just had an 18 minute conversation with it.

It's still using gpt-3.5-turbo.

[Startup Archive @StartupArchive_]

Peter Thiel: “AI in 2024 is like the Internet in 1999”

“It’s clearly going to be important, big, transformative, have all kinds of interesting social and political effects - maybe even effects about how humans think about themselves. But on a business level, it’s very, very treacherous. There were a lot of different Internet businesses that failed, and even the ones that succeeded, it was quite a rollercoaster.”

He gives Amazon as an example. In 1999, it hit $113 a share, but by October 2001, it declined to $5.50.

“If you’d held it from December 1999 to today, you would have made 25x your money, but you would have first lost 95%. And then if you’d bought it in October 2001, you would have made 500x. So in some sense, Amazon was the obvious Internet company to invest in, and even that was quite a roller coaster.”

He continues:

“My suspicion is that that’s roughly where we are in AI. It’s correct as a technology, but extremely bubbly and crazed as a company-building thing or as a sector to invest.”

Video source: @triggerpod (2024)

[Brian Atwood @batwood011]

Conversational Canvas™️

[sindarin. @SindarinTech]

Rachel, the concierge on our website, is now powered by Llama 4 🎊

[Teortaxes▶️ (DeepSeek 推特🐋铁粉 2023 – ∞) @teortaxesTex]

OpenAI scraping the public web and your work, then selling you access for $2000: 😬🖕♻️🤬🤢
DeepSeek training on your work, then returning it for free and compiled as part of a model: 😻🦾🐘🐳🇨🇳

[sindarin. @SindarinTech]

@omooretweets @a16z @BlasMoros

[kache @yacineMTB]

If you don't like vibe coding it's probably because you have no vibes to begin with just a completely vibeless individual

[Startup Archive @StartupArchive_]

Mark Zuckerberg on the importance of engineers if you’re building a technology company

“We never thought about ourselves as a website or a social network or anything like that.”

Mark believes many companies define themselves too narrowly:

“It’s one of the things I observed as soon as I came out to [Silicon] Valley. All these companies that called themselves technology companies were not really set up that way. The CEO wasn’t technical. The board of directors had no one technical on it… And it’s like alright, if that’s your team, then you’re not a technology company.”

He believes there’s a balance:

“You don’t want everyone to be an engineer because there’s other things that matter too. But if you don’t have a high enough share of the company as engineers, then you’re not a technology company.”

This makes sense when you view it in the context of Mark’s strategy for Meta:

“I define our strategy as: If we can learn faster than every other company, we’re going to win. We’re going to build a better product than everyone else because we’re going to get it out first, we’re going to have a good feedback loop, and we’re going to learn what people like better than other people.”

He concludes:

“I think that’s basically the formula. Be a technology company. Build a good foundation. Learn from what other people are focused on in the world. And iterate as quickly as you can.”

Video source: @AcquiredFM (2024)

[sarah guo @saranormous]

https://t.co/RJGFaGzJOb

[sindarin. @SindarinTech]

Should we build a smart speaker with fully-customizable voices, arbitrary function-calling, an integrations marketplace, and (optionally) full self-hosting?

[sindarin. @SindarinTech]

Poll:

[Dwayne @CtrlAltDwayne]

@batwood011 @SindarinTech Please do. I want ChatGPT level AI I don't have to open an app for.

[Brian Atwood @batwood011]

The full problem statement is:

How can you get the lowest possible latency with the smartest possible model at the lowest possible price to accomplish business objectives to the highest possible standard with the best possible UX?

[Brian Atwood @batwood011]

This is why we spend weeks to reduce the latency in our conversational engine by as little as 100ms at a time.

Right now, most solutions still hover around 1.5-2s.

Speaking with AI will never feel comfortable until the latency is reliably 200-500ms.

And that won’t happen by settling for good enough.

It takes real obsession.