Nicolas Parpandet

[Nicolas Parpandet @1g6]

@antirez @AMD Ubuntu 26.04 the latest LTS!

[Nicolas Parpandet @1g6]

@saidotdev Qwen 😅

[antirez @antirez]

DeepSeek v4 PRO running via SSD streaming on my 128GB MacBook m5 max. 1.6 trillion parameters.

[Nicolas Parpandet @1g6]

@analogalok It's more 131k context length than 256k

[Nicolas Parpandet @1g6]

@ivanfioravanti Just use ipv6

[Nicolas Parpandet @1g6]

@antirez @nfttank The question is about the Quant !

[Nicolas Parpandet @1g6]

@TheFastestDiet @Rainmaker1973 We are still using Cavendish experiment today to verify G value

[Nicolas Parpandet @1g6]

@elonmusk How many whales were injured 😅

[Nicolas Parpandet @1g6]

@IlkanAkten @UnslothAI Yes Moe with MTP I get 73 tok/sec and without 63 tok/sec. But with MTP I use a lot more vRam I have to shrink the context size a lot !

[Nicolas Parpandet @1g6]

@UnslothAI @Alibaba_Qwen Not sure, but the MOE version I have only x1.15 😅

[Daniel Moll @rumgewieselt]

The llama.cpp crowd are just testing now this PR! 😆

ITS MERGED!!!

https://t.co/v8RK4LK4k1

[Nicolas Parpandet @1g6]

@Maor_Elkarat Qwen 3.6 and Gemma 4 (MOE versions)

[Nicolas Parpandet @1g6]

@jun_song Me doing inference on 16 GB vRam 😂 RTX 5000 mobile

[Nicolas Parpandet @1g6]

@Turblog @dgfip_officiel Fusionne les factures !, une facture par mois

[Nicolas Parpandet @1g6]

@HermesAgentTips Laptops with RTX A5500, and 128GB, best tok/sec/bucks !

[Nicolas Parpandet @1g6]

@rumgewieselt So true 😂

[Daniel Moll @rumgewieselt]

The llama.cpp crowd are just waiting for one PR! 😆

♥️- PR#22673 -♥️
https://t.co/v8RK4LK4k1

[Fabien @Fabien_Mikol]

Arthur Mensch (Mistral) : "aujourd'hui les ingénieurs logiciels chez Mistral n'écrivent plus de ligne de code", ce sont des "managers d'agents" ; la productivité est énorme pour un individu, mais au niveau d'une grande entreprise il reste un goulot d'étranglement organisationnel.

[Nicolas Parpandet @1g6]

@jun_song Please show some evidence, looks BS

[Nicolas Parpandet @1g6]

@jun_song @Kimi_Moonshot @Zai_org @deepseek_ai @Alibaba_Qwen @ErnieforDevs @XiaomiMiMo I was very impressed by xiaomi models when it was freely available on openrouter for few days (Hunter & Healer)