M3 Ultra Mac Studio Al Cluster
Uses EXO 1.0 with RDMA over Thunderbolt 5 (80Gbps) for 2TB unified memory @ 3.2TB/s.
Runs Kimi K2 Thinking (1T parameters) at 28 tok/sec with MLX tensor parallel. Up to 1.8x TPS w/ 2 Macs, 3.2x w/ 4 Macs.
EXO 1.0 is now open-source (Apache 2.0).