Coiso

[Coiso @james151br]

@coldniko @Robert_of_Maine @murasametech Based on what only you @coldniko knows. What would be your recommendation, save some money and buy 2 3060 or sell an arm and buy one 7900 or 3090?

[Coiso @james151br]

@coldniko @Robert_of_Maine @murasametech Things are evolving so fast that we don't know what to do. That why I was asking.

[Coiso @james151br]

@maruru_289 No worries at all! Thank you so much for all your hard work in putting together such a wonderful resource for the community. Take care and best of luck with everything! 😊

[Coiso @james151br]

@rkupper @AkitaOnRails Poderia compartilhar o resultado dos seus testes?

[Coiso @james151br]

@dumblebackdoor @ashxhart @fragtalife Thks a lot for this fantastic work.

[Coiso @james151br]

@coldniko @great_garbanzo Quick question, sorry if this is obvious: what's the "fast mode" for Qwen on B65? I checked 0.2.8 and the only "Faster mode" I found in the docs is DeepSeek's 5-of-6-experts thing. Which switch am I missing? 😄

[Coiso @james151br]

@great_garbanzo @coldniko FYI, the MistVVK/XeStrata fork gets ~1550 tok/s 100K prefill and ~55–60 decode on the same card if that's of interest.

[Coiso @james151br]

@great_garbanzo @coldniko decode: ~37 tok/s on decode-heavy, ~38 short, ~42–44 small/medium, ~37 at 100K context

prefill: ~850 tok/s at 8K, ~700 at 100K — long prefill is the weak spot on single B-line.

Haven't tried fast mode yet, will report back if it moves these numbers.

[Coiso @james151br]

@dumblebackdoor @ashxhart Thks for that. I'll take a look.

[Coiso @james151br]

@SamPancher @grok pode resumir o pronunciamento do tweet?

[Coiso @james151br]

@coldniko Well done m8. Fantastic job. Thank you!

[Coiso @james151br]

@dumblebackdoor @ashxhart Great job.

[Coiso @james151br]

@coldniko 👀👀👀👀👀👀👀

[Coiso @james151br]

@coldniko @ivanalog_com So, Lord Niko, since you’re holding the secret recipe until next week... if I'm GPU hunting right now (new or used), which card should I prioritize that won't require a second mortgage like a 5090? 👀

[Coiso @james151br]

@xyster Great job. I'm following your work and just want to say thank you.