SemiAnalysis’ OpenAI Jalapeño blog shows an obvious industry trend. OpenAI wrote the entire inference stack in pure assembly. No framework required. All from hillclimbing.
Traditional ML frameworks like PyTorch are vanishing from the frontier stack. We already saw this with @elonmusk announcement that the entire SpaceXAI stack is in C.
I think you will see all frontier labs and inference providers converge to AI generated training and inference stacks in C / assembly.
It is a bit nostalgic, as the AI industry would never have started without ML frameworks but the future of serving hill climbed assembly is obviously coming.
For anyone who missed the live stream, or just wants to watch the keynote by @clattner_llvm, @iamtimdavis, and other folks again 🚀
A huge thanks to @Modular and @Qualcomm for making this ecosystem available as open source after all their hard work 🔥
https://t.co/UDdLkeCoCD
The only sad thing about the AI era is that I can no longer use, except in papers, the em dash (i.e., "—"), because otherwise people think I'm an AI myself 🤣
@clattner_llvm Absolutely incredible milestone, thank you! Really looking forward to diving into it, seeing how MLIR/LLVM is used behind the scenes, and hopefully contributing along the way 🚀
The Modular ecosystem is now Open Source! 🚀
From Max to the Mojo compiler, built on MLIR/LLVM.
Breaking news, huge thanks to @clattner_llvm and everyone who has worked on this over the past 4.5 years!
@adityazero_@clattner_llvm I haven't dug into it thoroughly yet, but from what little I've seen, Max is implemented in Mojo, and dialects seem to be upstream. I'm really curious to see how it differs from other AI compilers, too!
If you discover anything interesting, don't hesitate to reach out to me 🙏