A growing platform for thoughtful stories, reflections, health insights, business ideas, and more. Submit original articles personal essays, or expert pieces.
SpaceX has almost finished writing V1.0 of an in-house AI training stack in C that exact-maps to 220k GB300s with 800G NICs, making heavy use of pipeline parallelism and getting as close to bare metal as possible.
The potential speed improvement vs JAX for large training runs is over an order of magnitude.
Grok foundation model V9-Medium (1.5T) has finished training. Evals look good. A lot of Cursor data was added in supplementary training and there is more to come.
Fine-tuning is underway and reinforcement learning begins in a few days. 2 to 3 weeks to public release.
This will be a major improvement over the 0.5T v8-small that currently serves all Grok production traffic, especially for difficult coding tasks.
A Lifeline for Educated Homemakers and Talented Women
Perhaps the most beautiful aspect of Blogger is its power to empower.
Millions of highly educated women — graduates, post-graduates, professionals — step into marriage and motherhood with love and dedication.
#blogger