2x 256GB > 4x 96GB > 1x 512GB Mac Studio M5 Ultra
Price: $21,996 (4x) vs $21,598 (2x) vs $22,299 (1x)
More Macs = more memory bandwidth = faster decode
You can connect Macs together with readily available Thunderbolt 5 cables. This is what enables them to pool memory. What makes them faster is tensor parallelism
Tensor parallelism splits every layer of the model evenly across Macs in a cluster. Each one only has to read its share of the weights when calculating a token, and they all do it in parallel
After every layer they sync a few KB over Thunderbolt 5. Over TCP/IP each sync cost ~300µs, which made splitting slower than one Mac. macOS 26.2 added RDMA, which cuts it to ~3µs
This 100x reduction in latency is what made tensor parallelism practical on Macs
Between the 2x 256 and 4x 96 you're trading off between usable memory and extra speed. I give the edge to 2x 256 given long context and concurrent sessions are key to agent use cases
4x 96 and 1x 512 are very close. I give the edge to 4x 96 since it’s much faster. Expert streaming from disk is also improving, which could let it run larger models without giving up context
#1 / 2x 256, ~480GB usable memory
-> Runs both GLM-5.3 and DeepSeek V4.1 Flash at 4-bit
-> ~1.6x faster than 1x 512 GB
-> Plenty of room for long context
#2 / 4x 96, ~344GB usable memory
-> Runs DeepSeek V4.1 Flash at 4-bit but not GLM-5.3
-> ~2.3x faster than 1x 512 GB
-> Less room for long context
#3 / 1x 512, ~490GB usable memory
-> Runs both GLM-5.3 and DeepSeek V4.1 Flash at 4-bit
-> 1x baseline speed
-> Plenty of room for long context
Each Mac in a mesh needs to be connected to every other one (you can't use a switch). Since M5 Ultras come with 6 Thunderbolt 5 ports, in theory you could connect up to 7 of them with 21 cables
However once you go above 4 Macs in a cluster it gets theoretical as there are very few benchmarks on these sorts of setups. The decode speedup also tops out, which is why we only recommend connecting 4 at most
Jump Desktop on iPhone Duo is sublime.
Multiple simultaneous connections, a new multitasking UX, and full dual-display support.
Plus 120 Hz with virtual displays and on-screen controls.
We’re looking for beta testers! Email [email protected]