Can't believe that I simply requested @elder_plinius (who jailbroke Fable), to liberate this model and he actually did!
The most powerful model that can run an just 8GB of vram/unified memory.
Thanks a ton @elder_plinius!
@sabeer do you not vibe code, @sabeer?
I think it's clear as day that the world has already changed fundamentally.
Forget about what's about to come, the existing tools we have at our disposal have already disrupted everything. A new world is emerging.
It's quite scary that there are not enough people in the world who actually care about open weight models. Let alone care, people don't even understand what's going on. Even Software Engineers don't care, forget about the rest of humanity. At the moment looks like a losing battle to be honest.
New TandemLLM version is out ๐ฅ
It honestly makes it so easy to get local models up and running on a DGX Spark!
QwenFlashNext + TandemLLM is super fast!
@0xBakeer@TandemLLM
TandemLLM 0.16.0 is out, and it's two projects now.
TandemEngine does inference work and nothing else.
TandemApp is the dashboard, Chat and gateway in front of it. It went open source today.
Each works alone.
What the split changes:
- The engine has no GUI any more. It serves the OpenAI-compatible API, health and metrics. Every page lives in TandemApp.
- TandemApp doesn't need my engine. It sits in front of any OpenAI-compatible server or cloud API and gives your clients one address.
- An API key can now name which backends and which models a client may run.
- Each project has a docs site with a version for every release.
Both are Opensource.
Details below, links in the last post.
@gnukeith that's what Im curious about!
whether it'd really be an upgrade over qwen flash bcs on benchmarks, flash next appears to be better!
and since it's only 6b active, it's also faster!
@HexFunk@OpenPleb@nvidianewsroom Although I disagree with ur comment Mr Reid, I humbly reject ad hominem attacks on the open internet. Primarily bcs such a behaviour can hurt delicate feelings of strangers on the internet, and feelings are supreme. I apologise on Cyb3rgam3r's behalf for saying the word I can't.