One thing we've been excited about since the beginning of Gabber is Avatars
Here we have Visemes animating the mouth on a ThreeJS rendered realtime AI powered VRM avatar
Can I build a realtime basketball coach that counts my shots and gives me voice feedback on my jump shot?
Using Qwen3-VL 30B and a conversational AI, I found out - build tutorial at the end
Link to try it below
Introducing Gabber
Realtime, multimodal AI inference + orchestration for Vision, Speech, and Language Models
Build AI that can see, hear, talk, call tools, and do anything for $1/hr
I built an AI personal trainer that counts reps for me
It went a little bit horribly wrong, but it mostly worked great
I'll link a blog post on exactly how I built it below
A real-time learning assistant that sees your screen, talks, and learns alongside you. All open-source models (Qwen3-VL, Parakeet, Orpheus) wired together
Homework, research, studying - all made easier
Watch the video to see just how well it did
Turned @Alibaba_Qwen 3-Omni into a screen-aware code copilot. It watches @dwyer_neil 's screen, catches issues problems, and suggests fixes. Ran on H100 (FP8 Dynamic Quant) via @GabberDev
New open-source multimodal models are wild. They don’t just read and write, but can see, hear, and think.
Here’s @Alibaba_Qwen Qwen3-Omni (thinking mode) running locally on an H100.
Smarter than 2.5, handles voice, tool calls, and real-time context.
@GabberDev will set these models free.