Open models need open infrastructure, and this crowd shows how many people are building it with @sgl_project@radixark Packed halls, big energy! #SGLang#Summit
You can run Muse Spark Open on a single TPU v7 host with SGLang-TorchTPU. But how does it hold up under a brutal workload like @SemiAnalysis_ AgentX?
@radixark and Google have been working on:
• 3× faster decode at small batch size, with custom megakernel and DFlash2
• 18% faster decode on 500K-token contexts, with independent KV streams and max-free attention
• Faster prefill for huge agent prompts, with fused MoE kernel and sequence parallelism
• Twice the context per chip, with compact fp8 KV cache
• Up to 77% more agent throughput, with HiCache and session-aware eviction
Code and recipes are available👇
https://t.co/kV7KEmpo0Q
If your landlord said “object to my rent increase and I’ll double it,” that would be illegal.
So what do we call it when a railroad CEO says the same thing to every business that depends on him to ship their goods? Because Jim Vena is on video doing exactly that.
@itsme_urstruly "With the world so set on tearing itself apart, it don't seem like such a bad thing to me to want to put a little bit of it back together" - Hacksaw Ridge
@SawyerMerritt is it rolling just to folks who are still on 12.5.4.2 or others who got update 12.6.1? Seem like they are rolling different 12.6 versions to different HW3 builds
@scripwatch@CoderUday There's nothing wrong with focusing on domestic audiences—many have achieved incredible results doing so. However, to truly lead in any space, it's essential to create products that cater to a global audience and drive innovation, especially in this era of AI.
Satya Nadella sitting with a cup of chai, thinking: 'Should I use my $80B to take a majority stake in DeepSeek? 🤔 OpenAI who? I'll take all the models there.' 😏💸 @elonmusk
@Gabbar0099 Debt goes up to sustain growth. Correct metrics is Debt to GDP ratio, specially the external debt. The external debt to GDP ratio stood at 23.2% at the end of December 2014. In 2024, India's external debt to GDP ratio stood at 19.4%
@teslasi Folks I have been using 12.6.1 on my HW3 Model Y (2023 build). Overall the car has lot of confidence and the drive is smooth. However, I noticed a couple of times car stops on green light abruptly. Looking forward to the next updates.
@pduan@aelluswamy
🏃♂️ The AI race is on!
USA runner: sprinting ahead with $500B turbo boosters 🚀
China runner: keeping pace with $150B rocket shoes 🏯
EU runner: still on the starting line... carefully tying their laces with AI regulations 👞📜
#AI#TechRace#Priorities"
I’ve transitioned from using Google to relying on @perplexity_ai for all my searches, and the productivity boost has been incredible. The phrase ‘Google it’ had a good run. it’s time to make ‘Perplex it’ the new vibe 🕵️♂️💡 @AravSrinivas