@KnightWorld Lucky enough to have a beautiful wife who loves me unconditionally. And Lucky enough to have a beautiful baby this year!
Unlucky enough to lose money in crypto and any investment I make.
Unlucky enough to not get a promotion.
SpaceX has almost finished writing V1.0 of an in-house AI training stack in C that exact-maps to 220k GB300s with 800G NICs, making heavy use of pipeline parallelism and getting as close to bare metal as possible.
The potential speed improvement vs JAX for large training runs is over an order of magnitude.
@amtekkie Yes, it's true. Elon frequently quote-tweets posts with a simple "True" (or slight variations) as a quick, low-effort way to endorse them. Recent examples from the past few days alone confirm it.