@mark_l_watson can it be sufficiently good for anybody to actually use it in apps?
i dont want to dunk on it, it's amazing for 0.8b, but it feels so unreliable to me to actually be used in any real world scenario, even the simplest. maybe it gets it right sometimes, but not consistently
timelapse #87 (50 hrs):
- 2800x speedup
- i suggest you stop for a min and seriously watch this whole timelapse. speed and energy has been very consistent this time around.
- was relying on claude 4.5 sonnet but its only worth using on niche problems, not codebase refactors
- found myself deviating back toward xAI models by the end
- figured i should tackle the final boss of low precision GEMM kernels nvfp8 and nvfp4 which led me to cutlass and cute so im now tackling two chapters (gemm optimization chapter + cutlass/cute chapter) at once
- 30 min mentoring meeting
- figuring out how to get O-1 as soon as physically possible
- vibe coded weak + strong scaling tests for 8xH100 node
- worked my magic on quantized video lms
new monitor + headphones
- merged and simplified simonโs SGEMM_CUDA and pranjalโs h100 kernels to make my life easier on seeing the last of optimizations to apply
- optimized gemv, hopper gemm, ampere gemm, cuda core gemm, softmax, layernorm, topK chapter carefully being shipped
- implemented pipeline parallelism on 8xH100 for arbitrarily large MLP (inference only educational example)
- wont have to worry about quantization chapter until my editors look at it
- havent full polished the open source repos but ill roll those out passively
- everything is going my way except balance