M4 Mac Mini AI Cluster
Uses @exolabs with Thunderbolt 5 interconnect (80Gbps) to run LLMs distributed across 4 M4 Pro Mac Minis.
The cluster is small (iPhone for reference). It’s running Nemotron 70B at 8 tok/sec and scales to Llama 405B (benchmarks soon).
@RockstarSupport@matteoauriemma_ this is totally unfair, we're being punished for what other people do online!!, I just sent a ticket with them, why cant they get this under control!!
@lukas_playzz @RockstarSupport I can't connect either, even on the browser going on https://t.co/9RxtJazNkF does not load the page at all, console working just fine
@Odoo Please keep us updated when you're stable again, its a struggle on our end, network latency is also a struggle, we're really looking forward to the live events
Great job as always on the new release, keep it up
Time’s always moving on. Nothing can stop it. The question is whether we use our time well or not. We can't do anything about the past, but what happens in the future depends on what we do now. We can create a happier future by remembering that in being human we are all the same.