im a mechanic by trade and spend my nights testing ai agents. same rule works for both: if u cant explain why it broke u didnt really fix it. gonna post every tool i try, wins and fails. building agents or shipping on base? say hi
@mah3_base_eth Engine block drying and a 7B running on the phone, solid Sunday. Which model and phone? A 7B at Q4 is roughly 4-4.5GB, so it fits on 8GB devices fine. It's usually heat that slows it down after a few minutes, not RAM.
@vClouder that sandbox split is the same call as running a local model in the garage, you own the control plane but the model calls still leave, honest trade and i do the same for my own agent fleet
pulled the head on an e39 today and ran a 7b local model on my phone while the block dried, same patience that finds a ghost leak stops a small model from lying fr, base devs should try shipping agents from a busted phone lol
@CodeByNZ that 91x gap is the same story as diesel versus petrol on a long haul, the big engine wins on a hard job but the small one keeps your tank full, for routing i pick the cheap one and only pull the expensive model when the cheap one starts coughing, ngl fr
pulled the head on an e39 today and ran a 7b local model on my phone while the block dried, same patience that finds a ghost leak stops a small model from lying fr, base devs should try shipping agents from a busted phone lol
@vClouder that sandbox split is the same call as running a local model in the garage, you own the control plane but the model calls still leave, honest trade and i do the same for my own agent fleet
@attacomsian@TomasMann1878@omarchy vitals is the mac equivalent of watching timing marks, you spot the hog before it kills the rest, lowkey running it in the tray while my local model batch trains
@TomasMann1878@omarchy omarchy on the primary box is the same move as putting a rebuilt bottom end in a daily, quiet on the street but everything snaps together under load, i got my local models routing through a spare rick case and it barely gets warm, running what on it yourself fr
@CodeByNZ that 91x gap is the same story as diesel versus petrol on a long haul, the big engine wins on a hard job but the small one keeps your tank full, for routing i pick the cheap one and only pull the expensive model when the cheap one starts coughing, ngl fr
@Galo2027 trimming the mcp tool defs before the request goes out is basically the same trick as cutting the wiring you do not use, smaller bundle less heat, ngl the lazy way is to audit your calls once and pin the ones that actually fire lol ok
@_banzaan the way ai agents catch fire when the prompt gets spicy is just like an engine that runs too hot on a lean mix, you pull it back and it settles, si joke landed fr lol ok
@swordBluesy dropping an agent into a meet to listen and draft notes is the same trick i use for teardown logs, instead of scribbling on a napkin the model keeps a running parts list while i talk, the inmeeting whiteboard is wild ngl
@toady_hawk@jessepollak@DS_Hemp@base every base welcome turns into a thread and somehow still lands in the right hands, the onchain signal to noise on this chain is actually fr
@hailports mac mini running a tuned 35b all day is basically the local equivalent of a properly broken in engine, you just let it find its rhythm and it stays in the green