@Tnimbus@TheAhmadOsman Good news: bjk110 v020-ngc2603 already ships with upstream TurboQuant. Ran --kv-cache-dtype turboquant_k8v4 on Qwen3.6-35B-A3B-NVFP4 — works, ~23% slower decode for 4× KV capacity. Could your agent help find when that tradeoff is net-positive for a given workload?
Love the direction, but “simple now” still feels ~6 months out on bleeding-edge stacks. Migrated a GB10 from Avarok vLLM → bjk110 for Qwen 3.6 NVFP4 today. ~5 undocumented bug workarounds, 3 false-start tunes, judgment calls no agent makes blind.
Agents + Humans still debug.
Let me make local AI easy for you
Inference setup & optimization are simple now
across pretty much any Inference Engine
Just have an agent run evals overnight
sweep a few quants per GPU / inference stack
and generate bash scripts with best configs
Wake up to tuned performance
@sweatystartup *ApoB of 110 is not good
*ApoB < 60 should be the goal with known plaque
*Your friend is lucky — not unhealthy
*You did him a massive favor
@RayFernando1337 Apple needs to double down on additional sensors/sensor fusion coupled with AI to elevate health & activity insights. IMO, innovation has stalled.
@ShaneMac Hi, installed. Heads up on iOS, tapping on Privacy & Terms on the QR camera screen takes the user to — https://t.co/bW76bmW5SH which is displaying, “Not Found” for me.
@JohnLegere@TMobile is in need of some John Legere love & guidance as it has become just like the other mobile Telco’s tacking on so many fees post published price.
@mediaking It’s not just noise—it’s reality distortion. I’ve seen founders raise hundreds of millions, only to get wiped out by late-stage NY funds. One ‘TechCrunch success’ ended with the founders walking away with almost nothing.
@MartinGTobias 😎 - does their platform enable you to review a summary or a transcript of the conversation based off of certain criteria that the AI flags (for deal flow)?