Mike Ducharme

[Mike Ducharme @MikeDucharme]

@TencentHunyuan There's a gap in the 128GB market. A 2bit quant could become a leader in that segment. Any chance of getting Q2 and Q3 quants to experiment with?

[Mike Ducharme @MikeDucharme]

@jietang 128GB is the new middle class open model baseline. Release a dense and MOE 80-120b based on 5.2 and dominate the market.

[Mike Ducharme @MikeDucharme]

@frank_seravalli

[Mike Ducharme @MikeDucharme]

@Awk20000 @TheOnion @timheidecker collab with Destiny as editor in chief with guest spots on political panel segments for the memes when?

[Mike Ducharme @MikeDucharme]

@TheAhmadOsman An 80-90B dense would dominate the market at 128GB along with their 27B. Such a huge opportunity to fill a market gap being wasted. I hope they prove me wrong.

[Mike Ducharme @MikeDucharme]

@ivanfioravanti Is this a Q4 or Q5 quant? Based on 128gb, why you wouldn’t at least be running Q8?

[Mike Ducharme @MikeDucharme]

@theblackvault

[Mike Ducharme @MikeDucharme]

What software devs trying to keep up with AI advancements be like https://t.co/Lm0HTs2LNE

[Mike Ducharme @MikeDucharme]

@julianharris @iamtrask Great high-level read! I’ll be trying omlx and I’m glad you link to examples. You might want to also mention that the output quality of these local models is lower than cloud/frontier but will improve in your predictions section so readers don’t assume they’re at parity today.

[Mike Ducharme @MikeDucharme]

@julianharris @iamtrask I’m in the same boat. So many model runners, quants, tools (turboquant, dflash), etc. it’s hard not to get trapped into a paralysis of choice. Good luck!

[Mike Ducharme @MikeDucharme]

@Ida_Eng @babybeginner The bins or the rats?

[Mike Ducharme @MikeDucharme]

@julianharris @iamtrask Which Gemma model/quant are you using? I’m setting up a new claw with same system but it’s hard finding the local “sweet spot” model to get the most reliable responses/harness utilization.

[Mike Ducharme @MikeDucharme]

@ale1735187 @TheAhmadOsman Which 8bit KV quant versions are you using for these two or did you roll your own? I’d like to give them a try for myself if they’re on HF.

[Mike Ducharme @MikeDucharme]

@Novack_ @sudoingX Glad to hear it worked out!

[Mike Ducharme @MikeDucharme]

@_JordanDecker

[Mike Ducharme @MikeDucharme]

@dlwiest @bizlet7

[Mike Ducharme @MikeDucharme]

@PrincipalSmart @kim_gaetz They streamed themselves handing out the cash in envelopes. https://t.co/eCZzm6kLvF

[Mike Ducharme @MikeDucharme]

Happening Now: Group walking around handing out envelopes with $200 cash to convoy participants. This was on Wellington an hour ago. @OttawaPolice does this activity count as illegally "assisting others in the blocking streets"? #Ottawa #ottnews

[Mike Ducharme @MikeDucharme]

@kim_gaetz @milly72810023 I wonder if they know who these people are. I posted this from one of the live streamers back then:

[Mike Ducharme @MikeDucharme]

Happening Now: Group walking around handing out envelopes with $200 cash to convoy participants. This was on Wellington an hour ago. @OttawaPolice does this activity count as illegally "assisting others in the blocking streets"? #Ottawa #ottnews

[Mike Ducharme @MikeDucharme]

@rightblend @glen_mcgregor Three days later https://t.co/l6J64BkPv7

[Cat Tunney @cattunneycbc]

This is a part of town dense with apartments/condos/office space.