Newton-Schulz is what makes Muon work, but it's also a massive pain compared to Adam. *Dion3* makes it ~6x faster and more parallelizable too.
Combines our work on row-filtered gradients, Gram-NS alg, and GPU kernels in one package. Try pip install dion!
https://t.co/TDkTM5SqqK
Last summer, I had been struggling for two weeks to rigorously prove my intuition on a stats project.
A few days ago, I dug up the old latex file and spun up Aristotle (@harmonicmath), OpenGauss (@mathematics_inc), and Axiom Lean Engine (@axiommathai).
All four theorems are now formally verified in Lean 4. Here's what happened 🧵
arXiv link: https://t.co/XYopl8kHIc