Brian Bailey

I want to live in a Twin Peaks where the Cthulhu mythos & Delta Green are real.

[Rohit @HeyRohhit]

In 1983, a BBC interviewer asked Richard Feynman why two magnets push each other apart — and he refused to answer it.

What he did instead is the best seven minutes on thinking ever filmed.

Bookmark & watch today, no matter what.

[Alok @analogalok]

The VRAM barrier is officially dead.

I just ran Qwen 3.8 Flash Next (MoE) 125B A6B with a 250,000 context window on a single 24GB RTX 4090.

21 tokens/sec decode. 364 t/s prefill.

no mtp. no dflash. no kv cache quantization!

We are running datacenter models on consumer hardware.

Tested on Ubuntu 22 | CUDA 13.0 | PCIe 4.0 x16 | 110 GB DDR4 System RAM with a continuous 28k prompt across all runs.

### The Benchmarks & Scaling

# 1. Hybrid Offload (-ncmoe 40 @ 80k Context)
Offloaded 40 expert layers to the GPU, pushing VRAM to the ceiling.

./build/bin/llama-server -m Qwen3.8-Flash-Next-UD-Q4_K_XL-00001-of-00004.gguf -c 80000 --port 8080 -v --fit off -b 4096 -ub 4096 -ncmoe 40

Prefill: 383.85 t/s | Decode: 22.52 t/s
Footprint: 23.85 GB VRAM | 97 GB RAM

# 2. Full CPU MoE Offload (-cmoe @ 80k Context)

Pinned all 512 expert layers to DDR4 RAM (-cmoe), keeping attention on the 4090.

llama.cpp flags: (Same as above, replace -ncmoe 40 with -cmoe)

Prefill: 355.72 t/s | Decode: 20.84 t/s
Footprint: 11.66 GB VRAM (12GB+ VRAM freed up!) | 110 GB RAM

# 3. The 180,000 Context Run

Prefill: 357.75 t/s | Decode: 20.98 t/s | VRAM: 15.6 GB | RAM: 110 GB

# 4. The 250,000 Context Absolute Ceiling

./build/bin/llama-server -m Qwen3.8-Flash-Next-UD-Q4_K_XL-00001-of-00004.gguf -c 250000 --port 8080 -v --fit off -b 4096 -ub 4096 -cmoe

Prefill: 364.29 t/s | Decode: 20.97 t/s

Footprint: 18.3 GB VRAM (Still ~5.7 GB of VRAM headroom!) | 110 GB RAM

### Key Insights:
-b 4096 -ub 4096: doubles the prompt ingestion from ~150 to 364+ t/s.
-cmoe Free Lunch: Shifting expert layers to DDR4 RAM slashes VRAM from 24GB to 11.6GB with virtually zero decode penalty (22.5 -> 20.9 t/s), enabling the 250k context ceiling.

Qwen 3.8 Flash-Next (UD-Q4_K_XL) is a massive 111.4 GB model split across 4 shards. To run this architecture, you must build from the experimental PR branch (#27742) by @danielhanchen:

git clone && cd llama.cpp
git fetch origin pull/27742/head:qwen-next && git checkout qwen-next
cmake -B build -DGGML_CUDA=ON -DCMAKE_CUDA_ARCHITECTURES=native -DBUILD_SHARED_LIBS=OFF
cmake --build build --config Release -j $(nproc) --target llama-server

A single 4090 paired with 100 GB of cheap DDR4 RAM will comfortably serve production grade 125B inference.

While Qwen 3.8 27B (dense) still holds the crown for single 3090/4090 rigs, Flash Next proves 125B hybrid models are officially viable on consumer hardware.

Hugging Face GGUF link and complete performance telemetry graphs are dropped in the replies below.

GLM 5.3 Flash VS Qwen 3.8 Flash Next, which one takes the open weights crown this week?

[Massimo @Rainmaker1973]

Inertia log splitter

[Brian Bailey @baalazathoth]

weeeeeeeeeeeeeeeeeee

[mac @macs0x]

@elonmusk Show us the way Elon

[Brian Bailey @baalazathoth]

... mmmmm

[Brian Bailey @baalazathoth]

There are a number of pictures of Jesus' side being pierced, but none of them make the guy look as much of an asshole as this one.

[Brian Bailey @baalazathoth]

@PopCounts Always room for a few more.

[Brian Bailey @baalazathoth]

Clemency for Ross Ulbricht: Condemned to Die in Prison for an E-commerce Website - Sign the Petition! https://t.co/vjZpqJnggl via @Change

[Brian Bailey @baalazathoth]

This guy is fantastic.

https://t.co/NQCwoNoHA8

[🇪🇬Canadian🇮🇳earth🇰🇪quake🇹🇷researcher🇮🇩 @mxdondevivo]

Yesterday I raised alarm that we went 19 days without any 6+ earthquakes worldwide. Well now we are at 20 days! Notice how eerily silent everything is getting? Let's review all these slowdowns the media is hiding cuz they DON'T WANT YOU TO KNOW IT MEANS A MEGAQUAKE IS COMING! 🤓

[Brian Bailey @baalazathoth]

I never thought I would see a version of Seasons in the Sun that would have me laughing, but they did it. They fucking did it.

https://t.co/gutAdMWogm

[Brian Bailey @baalazathoth]

I'm sold. AI can go ahead and start making all commercials.

https://t.co/P1NuHOjf8i

[Brian Bailey @baalazathoth]

https://t.co/FFFlJP9dW1

[Brian Bailey @baalazathoth]

@internetarchive
is IA having issues right now? I keep getting a e_adept_no_token error message. Even with two different browsers and cleaning out history, cookies, cache, etc.

[pikat 🇭🇰 @pikatl]

homework

[Brian Bailey @baalazathoth]

https://t.co/Dww9OPIeDo