I've gotten a sneak preview of this. Very good. You're in for a treat with a complete breakdown of all the awesome new bits in Rails 8. Love that The Rails Foundation can fund this kind of quality production!
M4 Mac Mini AI Cluster
Uses @exolabs with Thunderbolt 5 interconnect (80Gbps) to run LLMs distributed across 4 M4 Pro Mac Minis.
The cluster is small (iPhone for reference). It’s running Nemotron 70B at 8 tok/sec and scales to Llama 405B (benchmarks soon).
I think there's room for many different paths in the framework world, but also that it's healthy to draw contrasts: There will never be a Rails Inc. We will not raise venture capital. We will not pursue our own cloud. Just great open source work, available for free, forever.