@KaiXCreator Was talking with a friend in his final year of CS and decided to take one of his practice tests
Was insane handwriting code again but still got it, and completely understand why professors do it
Been testing Qwen 3.6 with MTP locally and the multi-token prediction approach really does change how local inference feels. Not just faster, the planning ahead part makes it noticeably more coherent on longer coding tasks. Running on a single 3090 too
swapping out my 3090 for an M4 mac mini for local inference. less heat in the garage, more tok/s per watt. sometimes brute forcing with nvidia isn't the answer
the more i work with local LLMs the more i think the real bottleneck isnt compute its context management. like qwen3 30b a3 can reason circles around most cloud models if you set up the prompt chain right. anyone else finding this?
been running Gemma 3 27B locally on my M4 Pro and the latency is actually competitive with cloud APIs for most prompts. local inference is getting real
just saw someone share real data that 68% of AI agent code changes have mistakes. honestly surprised it's that low. the real skill isn't prompting, it's knowing what good output looks like so you catch the 68%
spent the weekend tuning my local mistral setup instead of my golf swing. monday morning code review is gonna hit different when i'm running inference at 2am