Hi, I'm Yash.
I'm building OvertChat — the front door for local AI. Your models, your server, your family's accounts. No API keys, no cloud.
Because a model on your GPU is just infrastructure. Local AI that's actually usable → https://t.co/h31XEPjXr1
@djnmrjnvc@TechMDAI Yeah, just couldn't find a recipe for it. Made one myself in case anyone else needs it - https://t.co/AWL4YtQp5U (uses diffbots weights)
@noozie@TechMDAI Tried Maya, it's definitely good but no parallel decode kills it for me. Requests get queued unlike GLM 5.3F on Maya. Maybe they'll have a fix for it soon?
Hi, I'm Yash.
I'm building OvertChat — the front door for local AI. Your models, your server, your family's accounts. No API keys, no cloud.
Because a model on your GPU is just infrastructure. Local AI that's actually usable → https://t.co/h31XEPjXr1
@gabu3d_pl@gospaceport me running DavidAU/Qwen3.8-Flash-Next-Abliterated-Uncensored-Turbo-Brilliance-50x-Reasoning-Instruct-GSQ-RCO-GGUF on a single 3090
Zero local AI experience. Stumbled on a random YouTube channel talking about why local matters, stop relying on the cloud so much. Saw the quad 3090 rig on a DIY rack and that gave me all the permission I needed.
My version just involved a lot of zip ties and 10x 3090s.
That's where I landed. No API. Big electricity bill. My whole household chats on it now.
@gospaceport thank you for the rabbit hole 🫡
@axitek You don't necessarily need 240V circuit either haha. I was using 1x 1600W per circuit (I was using a 25ft extension cord for the second). It might sound janky, but if you don't have kids/pets in the house it works pretty well.