I wanted a task that was fully deterministic, fully checkable, and genuinely hard to fake.
Four models built a double pendulum with RK4 integration, exact energy tracking, and a hidden twin to measure the Lyapunov exponent.
All of them passed. Two verified by actually running their code. Two shipped without ever opening the file and were still correct.
The live demos and blind test are live now. Would love to hear what you notice when you play with them.
Today we are introducing Escha-W2 quantization.
A 2-bit Qwen3.6-35B-A3B model built for fast, local inference. The complete model is 12.3GB on disk—small, enough to run on a single consumer GPU — while averaging ~100% of FP8 performance across 12 benchmarks, including:
MMLU-Pro: 80.9
MATH-500: 93.8
GPQA-Diamond: 77.8
LiveCodeBench v6: 62.6
BFCL tool use: 88.9
RULER 8K–128K: 89.9
Commonsense-6: 76.1
On a single RTX 4090, the model runs:
225 tok/s single-stream generation
on 12.3GB on-disk model size
Compressing a 35B MoE model this far without collapsing its capabilities required more than a standard quantization pass.
We built an end-to-end compression system combining state-of-the-art low-bit quantization with model-aware fine tuning and recovery to preserve capabilities most vulnerable to low-bit error.
Quantizing the Qwen 3.6 35B model - from the base model to the final deployable checkpoint — took approximately 10 hours to complete.
Escha-W2 runs through a custom Qwen3-MoE runtime, which includes the weight loader, low-bit decoding kernels and serving integration required to execute the Escha format efficiently. The runtime currently supports SGLang and ZML deployment. vLLM and llama.cpp will be supported in the next release.
No retraining from scratch. No specialized accelerator. One consumer GPU.
Model download: https://t.co/hbO3VuoDGU
Runtime download: https://t.co/hrTpO4FvuA
Apache-2.0 model and runtime.
@finkd Broad access to superintelligence is still the better long-term path than letting any single lab dominate. Even if Anthropic currently leads in coding and enterprise, concentrating that power remains riskier than distributing it widely with strong safeguards.
Interesting.
Grok 4.6 releases around August 7. This will be the 1.5T model with significantly improved SFT & RL.
Grok 4.7 will be the 2.1T model released a few weeks later. This will be better than 4.6 in every way, except slightly slower to serve, albeit with even better token efficiency.
@JensenHuang Half these companies ship closed models. So the interesting question is what they’re each actually contributing to the open side, not that they signed