L00P

@LoopMoody

Joined October 2021

359 Following

13 Followers

1 Posts

LoopMoody retweeted

Eric ⚡️ Building...

@outsource_

4 months ago

My 4090 went from 26 -> 154 tok/s Qwen 3.6 27B🤯 Same GPU. Same Q4_K_M . No FP8, no extra quant. The unlock: ik_llama.cpp + speculative decoding using Qwen3-1.7B as the draft model. 85% acceptance rate. Full config + benchmarks 👇🏻

outsource_'s tweet photo. My 4090 went from 26 -> 154 tok/s Qwen 3.6 27B🤯

Same GPU. Same Q4_K_M . No FP8, no extra quant.

The unlock:
ik_llama.cpp + speculative decoding using Qwen3-1.7B as the draft model. 85% acceptance rate.

Full config + benchmarks 👇🏻 https://t.co/NUZec2Y7J0

146

128K

L00P

@LoopMoody

Last Seen Users on Sotwe

Trends for you

Most Popular Users