post training, finetuning, rl, inference, vllm, sglang, cuda, kv cache, systems engineering, operating systems, linux, kernels, compilers and other fun stuff
JUST IN: AI dating startup Ditto reveals 160,000+ students have signed up for its app that automatically picks their match & sends them a fully planned date itinerary.
Ox Alpha (stealth model) is free for the next week
- 1M Context
- Multi-modal
- Zero Data Retention
Generous rate limits, near unlimited usage
We have capacity for 100T tokens per day, lets see what you can do
@ChrisJMcCormick The extrapolation is that your spec is something like microgpt (scalar valued python with for loops etc), everything else is just a matter of compilation and PyTorch etc is kind of a crappy IR