Clarification: I consider a container or VM remote, even if it’s on the same physical host as the client. I also don’t think this means we’re all gonna be renting compute all the time, I hope there is a k8s-like worker plane that will run this anywhere
(@northflank already has this for agent sandboxes btw)
We redesigned the Northflank project dashboard around environments.
Projects now have a clearer view of each environment, with improved navigation, validation, responsive layouts and cleaner empty states.
Here’s what else shipped in May and June ↓
8/8
Also shipped: CLI sessions scoped to an org or team, improved workload identity flows, RBAC role specs, better service and job creation, multi-line command overrides and dozens of dashboard fixes.
Can a model run deeper at test time than it was ever trained to? And if depth becomes a loop instead of a stack, do we need better optimizers to keep training stable?
@CoreAutoAI is collaborating with @tilderesearch on an optimizer x architecture competition: "One Layer Deeper"
We picked a cursed problem y = x^(2^T) mod N where each squaring depends on the last. A vanilla transformer has a fixed depth so it falls flat on its face the moment T exceeds the serial compute it can do in one forward pass. A fun reminder that architectures have inductive biases.
This isn't quite a nano-gpt speedrun experience and it's not a typical @GPU_MODE kernel competition either, it's closer in spirit to the LLM efficiency competition I worked on many years ago with @weiwei_msr and @Jisaacso in that it's open ended in a specific way.
The UX is kernelbot like, your submission is a single python file that defines your model, optimizer and loss. You don't need a GPU to participate at all since we're reusing a queue based job system powered by @modal and @northflank
There's tons of unexplored ideas and I'm really not sure what will win out but I'd be particularly excited to see people playing with new optimizers, adaptive depth and depth extrapolation.
Since this is a new format, we'll work with the community to refine the rules for another week before we start for real. Submissions are open now!!
had a blast this weekend at the @aiengine_hack in London 🇬🇧
so impressive to see everyone’s trading strategies and so wild to see how much coding agents have levelled the playing field
so many folks with no engineering background building exciting stuff and getting it deployed on @northflank!
bUt I tHoUgHt YoU cAn’T dO tHiS oN kUbErNeTeS
@northflank with the fastest time to 100k sandboxes
huge congrats to everyone else, this is no small feat!