First local agent to beat Hermes on benchmarks!
✦ runs Qwen, Gemma, Llama via llama.cpp
✦ stable-prefix caching keeps sessions cheap
✦ TurboQuant cuts the KV-cache 6.4× smaller
✦ 37 tasks solved vs Hermes' 31 on GAIA Level 1
Open source on macOS, Windows & Linux 👇
@schwarzerrttr@aimlapi Day 0 indeed. Local-first by default, but @aimlapi is right there when you want cloud model choice. Best of both. https://t.co/WAmTrOmpSD
@gabrielabiramia Ha, fair, the benchmark's the headline, the economics is the point. 6.4x smaller cache and no per-token bill is what turns local from a demo into something you can actually ship. https://t.co/WAmTrOmpSD
@qutyquteshweta@svpino Agreed completely, speed means nothing if you can't trust it. Everything risky is gated and every action is logged for you to inspect. What would you want to see on the safety side?
@codewithimanshu@eyishazyer every step is an append-only trace you can replay, the prompt and skills are editable, and MCP lets you extend it. Audit, tweak, extend, all real, no vendor in the loop. https://t.co/WAmTrOmpSD
@zsh89821970@yume_arasaki honestly same gripe drove us to build it. browser latency stays low because we read ARIA snapshots instead of screenshots, so the model chews small context per step. no official per-click number yet, but try it and tell me how it feels on your hardware. https://t.co/WAmTrOmpSD
@hx0000001@adxtyahq You've basically got it, the model and chat daemon are identical, so effectively all of that 6-task gap is scaffolding: the prompt, the GBNF-constrained tool calls, and how state gets compressed between steps. https://t.co/WAmTrOmpSD