Our MLIR compiler stack converts high-level code to millions of scheduled microinstructions that execute at the speed of light, and has some pretty amazing profiling infrastructure too. If working at the frontier of compilers and kernels excites you, please reach out!
Many take the inefficiencies in todays ML frameworks as a given. At flappy we have the audacity to build a replacement from the ground up, supplanting the traditional kernel model with a pipelined GPU-resident virtual machine.
We’ve developed the world’s most complete megakernel framework. It can perform entire training runs, serve inference, play video games, and even do all three simultaneously in a single kernel.