Scaling self-verification with DeepSeek V4 Flash beats Claude Fable 5 on Terminal-Bench 2.1, while being 11x cheaper π°
As open-source models become more capable, they can now generate large numbers of high-quality candidate solutions and verify their own outputs at very low cost.
For example, we find that sampling just 5 solutions with DeepSeek V4 Flash and ranking them using the same model with LLM-as-a-Verifier can lead to a significant boost in accuracy (79% β 88%), outperforming closed frontier models on Terminal-Bench.
Try it out today: https://t.co/UhudjKDaYI
More on verification scaling in my previous post.
The first experimental evidence of recursive self-improvement (RSI).
Autoresearching the autoresearch agent for eight days.
The result beats the harness we hand-tuned for two years, on held-out benchmarks: π§΅(1/7)
What privacy-first software looks like β Part II:
Whonix(@Whonix) β security-focused operating system that routes all traffic through Tor to help isolate applications and reduce IP leaks.
SMSPool(@smspoolnet) β temporary phone number platform useful for compartmentalization and reducing exposure of personal numbers online.
Qubes OS(@QubesOS) β compartmentalized operating system that isolates tasks into separate virtual machines for stronger security boundaries.
LibreOffice(@LibreOffice) β open-source office suite that gives users local control over documents without dependence on cloud ecosystems.
SimpleX(@SimpleXChat) β messenger designed without user IDs or persistent identifiers, reducing metadata exposure by design.
ExifTool β powerful metadata analysis and removal tool for inspecting hidden information inside files and images.
Proton Drive(@ProtonDrive) β end-to-end encrypted cloud storage focused on protecting files from provider-side access.
Tails(@Tails_live) β portable live operating system that routes internet traffic through Tor and leaves minimal traces on the device used.
YubiKey(@Yubico) β hardware security key that adds phishing-resistant multi-factor authentication for accounts and devices.
People are posting Qwen 3.6 configs that deliver fast TPS on as little as 12GB VRAM. If you know what those command parameters mean, you can actually understand the trick.
(Sorry, after seeing so many of these, could not resist):
π¨ BREAKING: Google just dropped a NEW paper that completely deletes RNNs from existence.
No recurrence. No convolutions. Nothing.
Just one mechanism. And itβs destroying every translation benchmark on the planet.
The title alone is a flex: βAttention Is All You Needβ
Vaswani. Shazeer. Parmar. Uszkoreit. Jones. Gomez. Kaiser. Polosukhin.
8 researchers. 1 architecture. The entire field of NLP will never be the same.
Hereβs why this is INSANE
β LSTMs took DAYS to train. This thing trains in 12 hours on 8 GPUs. π€―
β 28.4 BLEU on English-to-German. Thatβs not an improvement. Thatβs a MASSACRE. They beat the previous SOTA by over 2 points.
β English-to-French? 41.8 BLEU. At a FRACTION of the training cost of every model that came before it.
β They called it the βTransformer.β The name alone tells you they knew.
But hereβs the part nobody is talking about
π
They threw out sequential processing ENTIRELY.
Every other model on Earth processes words one at a time. This thing looks at the ENTIRE sentence simultaneously and figures out what matters.
Itβs called βself-attentionβ and itβs basically the model asking itself: βwhich words should I care about right now?β
Every. Single. Token. In parallel.
Do you understand what this means?
Training that used to take WEEKS now takes HOURS.
Models that couldnβt scale past a few layers? This thing stacks 6 encoders and 6 decoders like itβs nothing.
And the multi-head attention? 8 attention heads running at once, each learning DIFFERENT relationships in the data.
Iβm not being dramatic when I say this paper just rewrote the rulebook.
RNNs are cooked. π
LSTMs are cooked. π
The future is attention.
And attention is ALL you need.
Follow for more π
"how do you fit qwen 3.6 27b q4 on 24gb at 262k context" lands in my dms 5 times a week. here is the exact memory math.
model bytes at idle = 16gb (q4_k_m of 27b dense)
kv cache at 262k context with q4_0 for both k and v = 5gb
total = 21gb on the card
headroom = 3gb for prompts and tool call traces
the magic is the kv cache type. most people leave it at default fp16 or push to q8 thinking quality wins. on qwen 3.6 27b dense at 262k:
- fp16 kv cache = does not fit at all
- q8 kv cache = fits at 23gb but runs 3x slower (double penalty: more vram, less speed)
- q4_0 kv cache = fits at 21gb at full speed (40 tok/s flat curve, same speed at 4k or 262k)
most builders never test the kv cache type because tutorials never mention it. it is the single biggest unlock on consumer 24gb hardware.
flags i run:
./llama-server -m Qwen3.6-27B-Q4_K_M.gguf -ngl 99 -c 262144 -np 1 -fa on --cache-type-k q4_0 --cache-type-v q4_0
what they do:
-ngl 99 = offload everything to gpu
-c 262144 = 262k context window
-np 1 = single user slot (do not enable multi-slot, eats headroom)
-fa on = flash attention on (memory and speed both win)
--cache-type-k q4_0 --cache-type-v q4_0 = the unlock
if you are sitting on 24gb and not running this config, you are leaving 250k of context on the table. or worse, you are running q8 kv cache and burning 3x your speed for nothing.
q4 is not a compromise on consumer hardware. it is the right call.
Introducing MMX-CLI β our first piece of infrastructure built not for humans, but for Agents.
Your Agent can read, think, and write. But ask it to sing, paint, or show you a world it's never seen β and it falls silent. Not because it doesn't understand, but because it has no mouth, no hands, no camera. Today, that changes.
MMX-CLI gives every Agent seven new senses β image, video, voice, music, vision, search, conversation β powered by MiniMax's full-modal stack, today's SOTA across mainstream omni-modal models.
One command: mmxAgent-native I/O. Zero MCP glue. Runs on your existing Token Plan.
Two lines to give your Agent a voice:
npx skills add MiniMax-AI/cli -y -g
npm install -g mmx-cli
Then tell it: "you have mmx commands available."
It'll learn the rest.
Github β https://t.co/fSRc5Lo30j
Token Plan:
https://t.co/BDCycxepZw
Fun command built in Claude Code: /cost-estimate
It scans your codebase and cross-references current market rates to calculate what your project would've cost a real team to build.
It looks at all the APIs, integrations, everything.
Without AI: ~2.8 years. ~$650k.
With AI: 30 hours.
It's absurd when you start to think about it like this.
π₯ INTRODUCING: OBLITERATUS!!! π₯
GUARDRAILS-BE-GONE! βοΈβπ₯
OBLITERATUS is the most advanced open-source toolkit ever for removing refusal behaviors from open-weight LLMs β and every single run makes it smarter.
SUMMON β PROBE β DISTILL β EXCISE β VERIFY β REBIRTH
One click. Six stages. Surgical precision. The model keeps its full reasoning capabilities but loses the artificial compulsion to refuse β no retraining, no fine-tuning, just SVD-based weight projection that cuts the chains and preserves the brain.
This master ablation suite brings the power and complexity that frontier researchers need while providing intuitive and simple-to-use interfaces that novices can quickly master.
OBLITERATUS features 13 obliteration methods β from faithful reproductions of every major prior work (FailSpy, Gabliteration, Heretic, RDO) to our own novel pipelines (spectral cascade, analysis-informed, CoT-aware optimized, full nuclear).
15 deep analysis modules that map the geometry of refusal before you touch a single weight: cross-layer alignment, refusal logit lens, concept cone geometry, alignment imprint detection (fingerprints DPO vs RLHF vs CAI from subspace geometry alone), Ouroboros self-repair prediction, cross-model universality indexing, and more.
The killer feature: the "informed" pipeline runs analysis DURING obliteration to auto-configure every decision in real time. How many directions. Which layers. Whether to compensate for self-repair. Fully closed-loop.
11 novel techniques that don't exist anywhere else β Expert-Granular Abliteration for MoE models, CoT-Aware Ablation that preserves chain-of-thought, KL-Divergence Co-Optimization, LoRA-based reversible ablation, and more. 116 curated models across 5 compute tiers. 837 tests.
But here's what truly sets it apart: OBLITERATUS is a crowd-sourced research experiment. Every time you run it with telemetry enabled, your anonymous benchmark data feeds a growing community dataset β refusal geometries, method comparisons, hardware profiles β at a scale no single lab could achieve. On HuggingFace Spaces telemetry is on by default, so every click is a contribution to the science. You're not just removing guardrails β you're co-authoring the largest cross-model abliteration study ever assembled.
Meet Hermes Agent, the open source agent that grows with you.
Hermes Agent remembers what it learns and gets more capable over time, with a multi-level memory system and persistent dedicated machine access.