It's been super rewarding to contribute to gVisor over the years and make it a secure runtime fit for the needs of the AI world. I'm very much looking forward to making it the best runtime for running AI systems out there, may it be coding agents, training workloads, or inference engines.
Super excited about this! I spent 6+ years on gVisor at Google, then recently joined Modal. It’s been an adventure pushing the frontier of gVisor’s capabilities and performance here.
@modal is one of the most advanced gVisor users, running 40M+ containers a day, so we care a lot about where the project goes. Glad to see it move to CNCF, and happy to be back as a maintainer.
gVisor is joining the @CloudNativeFdn, and Modal is becoming one of its maintainers.
We’ve run gVisor on Modal since day one. Along the way we've upstreamed: GPU support, multi-node training, snapshots, and more. All of it open-source.
We’re incredibly proud to grow from being a team that depends on gVisor to a team that also gets to help steer it.
In early 2022, the first “real” @modal user was using us for processing large scale weather data. We were anxious about going up to them and asking them to pay ~$500 for continuing to run these jobs. (We thought it was a lot!)
Obviously the numbers are much bigger now.
But we’ve also built so much more since then, and our velocity and ambition are growing even faster. This year, we figured out how to scale to millions of concurrent sandboxes, launch RDMA clusters securely and elastically for distributed training, train state of the art speculators for inference, build a whole new sandbox runtime, and more. So many great rabbit holes, and we’re going deeper down all of them.
If this sounds interesting to you, we’re hiring! https://t.co/2cZn0oFK3i
@BenKoska Cool! I’m a maintainer of gVisor. Working at Modal now. I was gonna add support for AMD GPUs soon. Since you already have it working, do you mind upstreaming it?