Small Model Lab

Building small but mighty special purpose LLMs. Bigger isn’t always better.

[Small Model Lab @SmallModelLab]

One of the best small models out now.

[Bindu Reddy @bindureddy]

Gemma 4 is a very good small model that punches above it's weight class

Gemma is a 31B model that is as good as other very large MoE models

It's the best in the world for it's size 👏👏

[Small Model Lab @SmallModelLab]

@bindureddy Yes! Great example of a very powerful small LLM 💪

[Small Model Lab @SmallModelLab]

@garrytan So excited for this Garry!

[Small Model Lab @SmallModelLab]

This deserves more attention.

[0xSero @0xSero]

This didn't receive the attention it deserved. They pre-trained this model completely peer 2 peer, no data-centers.

Everything was done over a permissionless network, I have tried the model, it's honestly not a good LLM but that's beyond the point.

We NEED this, we NEED an alternative.

- Download OpenCode
- Download Pi
- Pay for OpenSource
- Share your AI sessions
- Learn to do RL

We can't be at the mercy of ANY lab.

https://t.co/6ruL2lz2Dh

[Small Model Lab @SmallModelLab]

@0xSero @tplr_ai I was also surprised this wasn’t getting more attention

[Small Model Lab @SmallModelLab]

@jpidala @Alibaba_Qwen @openclaw @OpenRouter Super impressed with Qwen lately, 7B runs surprisingly well on a base model Mac Mini

[Small Model Lab @SmallModelLab]

@ns123abc Where do I get those sunglasses? 😎

[Small Model Lab @SmallModelLab]

@0xSero Yessss, do it!!

[Small Model Lab @SmallModelLab]

Super interesting data here, and amazing how long it takes to REAP these, but clearly worth it!

[0xSero @0xSero]

Qwen3.5, MiniMax-M2.7 are incredible acts of kindness that I don't think will be with us from so much longer.

Here's my update for you.

> I have 20 GPUs at full utilisation right now.

All these getting cooooompressed, no synthetic data

All runs will be done in 9 days, if I don't get a catastrophic failure - REAP for:
- GLM-5
- Qwen3-next-coder
- Qwen3.5-122B
- Qwen3.5-plus-397b

- Browser-use
- CUDA
- Terminal-use
- Coding
- Math
- Agentic trajectories
- 30% my personal chat session history

I am also removing refusals inspired by Prism. So no more I can't do this I can't do that blah blah

Inference for local AI

- Qwen3.5-262B-REAP - I've been using it exclusively in Parchi, perfect 100 tokens/s & 0 errors very good at browser use

-----------------

Secret

- Qwen3.5-27b - you will see when i'm done

Targeting the following hardware levels:

With full context 200-256k context in vllm, sglang, llama.cpp, exllamav3, and if people help MLX

16-32 GB - Qwen3.5-27b
32-48 GB - Qwen3-coder-next
48-128 GB - Qwen3.5-122B
128-256 GB - Qwen3.5-Plus-397B
196-512 GB - GLM-5.*

I am training them on 22,000 samples at 16k context

352M of custom selected calibration datasets.

My hope is to make the highest quality multimodal LLM compressions for this year.

20 GPUs running in parallel for the next 10 days

- 8x H100s - Qwen
- 4x B200s - GLM-5.*
- 8x 3090s - Testing

Once MiniMax-M2.7 is online 4 more GPUs will get to work.

[Small Model Lab @SmallModelLab]

@OpenAI Congrats, you can do a lot with $122B 🔥

[Small Model Lab @SmallModelLab]

@morganlinton 🦾

[Small Model Lab @SmallModelLab]

@0xSero Super interesting, thanks for sharing all the details, and I sure hope they’re with us for at least a bit longer!!

[Small Model Lab @SmallModelLab]

@morganlinton Small models FTW 🕺

[Small Model Lab @SmallModelLab]

Serious quant db heaven.

[Quant Science @quantscience_]

Python is mind-boggling for finance.

Case in point: There's a Finance database of 300,000 tickers.

Available 100% for free:

[Small Model Lab @SmallModelLab]

@quantscience_ Yes it is, and this db is crazy!

[Small Model Lab @SmallModelLab]

@KongBTC @morganlinton Yes it is 💪🦀

[Small Model Lab @SmallModelLab]

@morganlinton You had me at Deeper Rust Phase 🦀

[PyQuant News 🐍 @pyquantnews]

Factor investing is what made me stand out at JPMorgan.

But it took me years to master the information coefficient.

In 1 minute, I'll teach you the 10 things you need to know (that took me 1 year to learn).

Let's go:

[Small Model Lab @SmallModelLab]

@DeepValueBagger Yes, really excited for this one.

[Small Model Lab @SmallModelLab]

@KanikaBK Ohhh, these are great, thanks for sharing Kanika.