@fabiankamberi Nice app. We've also built a similar app called https://t.co/e8kiR8fxCZ and it has animated avatars and reddit like thread to share social interactions.
We used @GroqInc to build https://t.co/e8kiR8fxCZ and do real time text-to-speech -> llm -> speech to lip sync. And the best part, it was fast enough that we didn't have to even use streaming to shuttle requests.