Meet Mellum2.1 β JetBrains' open-source 12B MoE model built for coding agents and local execution.
π 140+ T/S in local testing scenarios
πͺπΊ Ethically trained European open model
π» Efficient worker model inside IDE agent workflows
Try it locally: https://t.co/7JuOGEDAHC
The most satisfying part was watching our RL infrastructure and training protocol mature over the summer. I can only imagine what we can build on this foundation next.
Mellum2.1 is out.
A major update to the Mellum2 we open-sourced in June. The architecture is unchanged, 12B mixture-of-experts with 2.5B active parameters under Apache 2.0. What is new is the scale of reinforcement learning in post-training: millions of sandboxed runs inside real repositories, aimed at agentic coding.
The result is a small model that works as a coding agent. On SWE-bench Verified we achieved 47%, with gains across coding, math, tool use, and general knowledge as well.
It is also the fastest model in its class. Under load it serves about twice the tokens of Qwen3.5-9B on a single H200.
Built for sub-agents, coding agents and private self-hosted deployment. Weights are on Hugging Face: both HF and GGUF formats. MTP support is on its way.
Blog: https://t.co/VZn3tmlQ2e
π€ collection: https://t.co/EvtnRyHh2d
Proud of this one. Try it and tell us what breaks.
That infrastructure unlocked full-scale training: millions of sandboxed runs feeding asynchronous RL with a CISPO loss, which we found gives noticeably more stable training than GRPO at this scale.
The biggest challenge this time was scaling RL itself. Millions of sandboxes need constant attention: provisioning, health, cleanup, and getting results back to the trainer in time. We built the infrastructure for hosting and managing them as a separate system, fully decoupled from training, which let us scale it horizontally by simply adding machines, without touching the training job.