@Samuel85999737 There is a lot of things happening around the world as well. Like wars around the world forced governments sell their gold, bitcoin, etc… to build factories, buy materials. They had places to use money, so the “money” could stay low for a while.
Ex-Berkeley PhD who leads SGLang at xAI explained how they serve Grok on 100K GPUs in 23 minutes - better than $2000 inference-at-scale courses.
split prefill and decode -> shard experts across GPUs -> route tokens per expert -> overlap comm and compute -> serve at DeepSeek-API-killing prices.
That loop is why xAI runs Grok on SGLang and third parties beat DeepSeek's own API by 5x on cost.
SGLang + prefill-decode disaggregation + expert parallelism + AMD MI300 - that's the stack.
Watch and save it, then read the article below.