Open models need open infrastructure, and this crowd shows how many people are building it with @sgl_project@radixark Packed halls, big energy! #SGLang#Summit
You can run Muse Spark Open on a single TPU v7 host with SGLang-TorchTPU. But how does it hold up under a brutal workload like @SemiAnalysis_ AgentX?
@radixark and Google have been working on:
• 3× faster decode at small batch size, with custom megakernel and DFlash2
• 18% faster decode on 500K-token contexts, with independent KV streams and max-free attention
• Faster prefill for huge agent prompts, with fused MoE kernel and sequence parallelism
• Twice the context per chip, with compact fp8 KV cache
• Up to 77% more agent throughput, with HiCache and session-aware eviction
Code and recipes are available👇
https://t.co/kV7KEmpo0Q
If your landlord said “object to my rent increase and I’ll double it,” that would be illegal.
So what do we call it when a railroad CEO says the same thing to every business that depends on him to ship their goods? Because Jim Vena is on video doing exactly that.
@itsme_urstruly "With the world so set on tearing itself apart, it don't seem like such a bad thing to me to want to put a little bit of it back together" - Hacksaw Ridge
@WHPressLeavitt Yes. Rediscovering faith is something the world might benefit from these days. Taking the quote from the Hacksaw Ridge movie "With the world so intent on pulling itself apart, maybe it's not such a bad idea to help piece some of it back together"
@SawyerMerritt is it rolling just to folks who are still on 12.5.4.2 or others who got update 12.6.1? Seem like they are rolling different 12.6 versions to different HW3 builds
@scripwatch@CoderUday There's nothing wrong with focusing on domestic audiences—many have achieved incredible results doing so. However, to truly lead in any space, it's essential to create products that cater to a global audience and drive innovation, especially in this era of AI.
Satya Nadella sitting with a cup of chai, thinking: 'Should I use my $80B to take a majority stake in DeepSeek? 🤔 OpenAI who? I'll take all the models there.' 😏💸 @elonmusk
@Gabbar0099 Debt goes up to sustain growth. Correct metrics is Debt to GDP ratio, specially the external debt. The external debt to GDP ratio stood at 23.2% at the end of December 2014. In 2024, India's external debt to GDP ratio stood at 19.4%