Rejoice RTX 3090/4090/5090 owners💫
Qwen3.8-27B EXL3 is here. This is an *experimental* release so there might be some bugs along the way!
As far as I know, this is the only way to serve Qwen3.8-27B with 200k+ context while using dflash2 on a 24GB VRAM, without sacrificing quality!
This is also the first EXL3 quant I've personally quantized.
Get it here:
https://t.co/6VvVGrV0iZ