Mini-AGI trains itself on a single 8GB laptop GPU, grows its own experts, and claims to fix catastrophic forgetting. Is that actually true?
One solo developer @volotat built mini-AGI, a byte-level language model that trains from scratch on a single consumer GPU and keeps learning continually instead of being frozen after one training run. In this breakdown we go straight into the GitHub repo and the README to unpack how it actually works: a recurrent transformer block with adaptive halting, a dynamic mixture-of-experts setup where every expert lives as a file on disk instead of GPU memory, and a specific trunk learning rate trick that the creator claims cut catastrophic forgetting from roughly 50% retained down to 99.84% in his own testing. We also cover the current training numbers, the held-out loss across eight different subjects, and exactly what the model can and can't do today.
This one is for anyone following open-source AI experiments, continual learning research, or the growing wave of solo developers building serious machine learning projects with an AI coding partner instead of a team. We also dig into the Hacker News reaction, which split hard between accusations of marketing overreach and genuine excitement about the underlying engineering, and lay out exactly what would need to happen — released weights, standard benchmarks, independent reproduction — before mini-AGI earns the name it's using.