Today I tried Strata on my Mac M5 Max 128GB with Qwen Flash Next unsloth-ud-q4_k_xl. Truly amazing performance, constant 89 Tok/s. I even selected to leave room for other work (Not at full performance). Well done! @coldniko Thank you! I have switched from mlx-serve.
Running deepseek 4.1 STQ using Sushi 1.6.0 on M5 Max 128GB under compressed air cooler to lower GPU temperatures. Removed seals for macbook @Beamsters1
@kimmonismus If you have got 128GB of RAM and M5 Max, go for sushi 1.5.1 and Deepseek STQ 1.75bwp. Twice as better than Qwen3.8-Flash-Next. His work @Beamsters1
Thank you @Beamsters1 After much testing and effort to free up as much memory on M5 MAX 128GB I have, finally switched to sushi 1.5.1 and DeepSeek STQ 1.75bpw. What an amazing model, work much better than Qwen3.8-Flash-Next. WOW! Now I need some water cooled body to put underneath my macbook max. Turned off Siri as well to save memory.
Please note model quality for Qwen3.8-Flash-Next matters for large / complex projects on MLX Enginees. Right now best one is:
ddalcu/Qwen3.8-Flash-Next-MLX-Serve-iQ-MLX-4.7bpw
Excelletn quality/speed on M5 Max 128GB
I have tested lots of Local AI MLX Engines for M5 Max 128GB. Below are top ones in order:
Model: ddalcu/Qwen3.8-Flash-Next-MLX-Serve-iQ-MLX-4.7bpw
1. Mlx-Serve (Recommended)
2. Sushi
3. OMLX
4. Strata
5. MTPLX
6. LMStudio
7. Ollama
Waiting EXL....