Alex D

[Alex D @Steady_Alex]

@Youssofal_ What quant are you using?

[Alex D @Steady_Alex]

@Forhanvv Don't forget to mention the 192GB system RAM 🤣

[Alex D @Steady_Alex]

@coldniko @sudoingX Too slow, 27b gets over 100t/s, Flash is in upper 20's

[Alex D @Steady_Alex]

@MiaAI_lab It's also bad and dumb. Failed all of my tests, when it finally finished them

[Alex D @Steady_Alex]

@alexandr_wang They are too poor to use the good one

[atomic.chat @atomic_chat_hq]

@nanbeige congrats on the release 🔥

just made GGUFs for it: https://t.co/1NYPhrnq7b

[Dank jetha @Dank_jetha]

Jerry Rig is a idiot.

[Alex D @Steady_Alex]

I am using Claw. There are a lot of sessions fixing bugs, but also adding features! (A real project concept, provider selection based in how much weekly sub is left for new sessions, prompting delegate sessions to ordinary (@heyneighbor , feedback: the delegated, limited session idea is confusing. I had to make a promoter)

[Alex D @Steady_Alex]

@axitek Sometimes quantity is it's own quality. Enough slightly dumber tokens outperform smarter ones

[Alex D @Steady_Alex]

@Abdullah1176491 @coffeedev Yes, lets let a3rd party decide to can access my private stuff because it's UX! Noob

[Alex D @Steady_Alex]

@syfert @coffeedev Skills issue lol

[Alex D @Steady_Alex]

@0xBakeer Wall clock time, my 3090 spends more time decoding that prefilling, mostly due to cache. My strategy is to max cache at at least q8, then the rest for moe cache and moe's where relevant

[Alex D @Steady_Alex]

@jaysinjailagain Clavicle: am I a joke to you?

[Alex D @Steady_Alex]

@jaysinjailagain You have no idea just how true it is. AI is a multiplier. It's that's to get much out of multiplying 0, but for those who master it? The power to accomplish the work of 20 men

[Alex D @Steady_Alex]

@NousResearch @pubity Please, your recent release shows that maybe you guys need to use more tokens

[Alex D @Steady_Alex]

@gem5472 @tomwookieford @larsmoravy Mission: impossible

[Alex D @Steady_Alex]

@MiaAI_lab It's so good

[Alex D @Steady_Alex]

@RusticStack I keep reading OC and thinking OR. Fair

[Alex D @Steady_Alex]

@ItsmeAjayKV My 3090 (128gb ram) does 17 on Flash Next, but fast prefil.

[Alex D @Steady_Alex]

@jtdavies @MiaAI_lab Do you need Blackwell to use it?