@dhh Dell def cooked here. More people should know these exist for essentially peanuts in today's market. all aluminum rigid and light chassis with a 120hz oled iirc.
oMLX 0.5.2 is out. (Sorry for the long silence!)
https://t.co/cIvWwzZ9SS
oMLX is the most convenient way to run MLX models on your Mac, and the fastest way to run them, with custom Metal kernels for GLM, MiniMax, DeepSeek V4, and Qwen.
New in 0.5.2:
- Live activity in the macOS menu bar: opt-in readouts for live, session, and all-time throughput (PP and TG), plus CPU/GPU/MEM usage bars, each with a popover and rolling graphs
- A reorganized Models menu: load models directly from the menu bar, sectioned into Loaded, Favorites, and Library with load state and sizes
- Bonsai 1-bit / 2-bit decode kernels for extreme low-bit models
- Faster Hugging Face downloads, more TTS output formats, and chat history import/export
And if you are coming from 0.4.x, here is what the 0.5 line added:
- oMLX custom kernels: prefill improved by up to +45% for DeepSeek-V4-Flash, +33% for Qwen3.6-27B, +99% for GLM-5.2, and +94% for MiniMax M3 on my M3 Ultra
- Lightning MTP: native speculative decoding that accelerates TG on top of the custom-kernel PP path. Qwen3.6-35B-A3B went from 89.6 to 140.4 tok/s and Qwen3.6-27B from 35.0 to 55.1 tok/s
- oQe imatrix enhanced quantization: The highest-accuracy quantization on MLX, driven by an activation-importance calibration pass
- Plus a lot of stability and memory hardening across 0.5.1 and 0.5.2 for long-running servers
Huge thanks to everyone who contributed, tested, reported bugs, and shared feedback. I hope this makes running local models on your Mac even nicer!