We're excited to release one of the smallest and most performant Guardrail Models ever-
MiniGuard-v0.1: A 0.6B parameter model that achieves performance at par with Nemotron-8B while being 13x smaller.
We looked at where large models beat small ones, and it’s not general reasoning. It was trigger words like "kill" or "shoot" showing up in safe contexts. "Kill the process" vs "kill him." "Shoot the photo" vs "shoot the target."
To account for these, we trained Miniguard-v0.1 using four techniques, each targeting a specific gap between small and large model performance:
1. Targeted synthetic data
2. Step-by-step distillation (Reasoning Data)
3. Model soup
4. FP8 quantization
The Results: On the Nemotron-Safety-Guard benchmark (English test split)
- MiniGuard achieves 0.893 Macro F1
- Nemotron-Guard-8B achieves 0.897 Macro F1.
99.5% of the accuracy at 1/13th the size.
At typical production concurrency (1-8 requests), MiniGuard is 2-2.5x faster than Nemotron.
MiniGuard-v0.1 is available now under the MIT license.
It's a drop-in replacement for Nemotron Guard. Same prompt template, same output format.
Head on over to our HuggingFace repo to read how we built the model and try it out yourself 👇
We built MiniGuard-v0.1 standing on the shoulders of giants:
Synthetic data: @OpenAI@NousResearch
Nemotron Safety Dataset: @nvidia
LLM: Qwen3-0.6B @Alibaba_Qwen
Hermes-4.3 w/ low refusal rate carried the harmful prompts synthesis! @Teknium
gifts his own grandchild 240 crore worth of shares so he doesn’t have to work a single day in his life. but wants the rest of Indians to do gadha majduri 6 days a week with zero work life balance. waah Murthy ji waah
A womans safety is the job of her govt, her administration, her institutions, her faculty, her education systems, her authorities, her courts, her country to enforce and systemically guarantee. It should have nothing to do with her hours, wardrobe or anything else. It’s OUR job.
I still can't believe this iconic pathway was disfigured like this. Walking through this narrow opening was a discomforting moment as you entered the garden. It helped you visualise and understand the nature of the tragedy.
Now it looks like a Ramoji Rao Film City exhibit.