powershell and llm inference struggles & shitposts |
local AI open source must win |
SRE @Proofpoint (opinions my own) |
left wing working class CA voter
@fromsoftserve@GheyForGames it was always about knowing the details, systems, and having taste. Using Claude is just freedom and speed for the human vision.
@can1357 Been using this update all week and it feels really good. VMware and Azure Windows VM connecting to multiple remote Tern in multiple tabs is crisp.
Go run this on your rtx3090. Atomic Q4_K GGUF is 16.5 GB.
Inkling 2 small has been fast+good for routine tasks and repo maintenance through CommandCode inference.
Some of you thought that Inkling 2 Small was too big at 594B parameters. We heard you: Inkling 2 Mini is a looped transformer with just 26B parameters, small enough to run on your laptop, powerful enough for agentic work with a score of 20.1 on AA Index.
https://t.co/9HzaUMwghb