Soham Konar

swe @glean, prev @meta cs @stanford

[Soham Konar @sohamkonar_]

@ishanskhare great work Ishan!

[Ishan Khare @ishanskhare]

Excited to share Context-Sharded Block Parallelism (CSBP) and Turbo-dLLM, our new optimized distributed training library for Diffusion LLMs!

Our distributed parallelism strategy unlocks significant training efficiency for diffusion LLMs, with speedup gains growing with context length 🚀

On 8x H100 GPUs, Turbo-dLLM accelerates DFlash2 speculative-decoder training by 2.48x at 512K and 7.59x at 1M context length.

Simply pip install turbo-dllm⚡️ or check out https://t.co/Mcme2NOA3Y.

Honored to work with @TarunSures41845, @PranshuChatur11, @hangoo_kang, @pshroff_ , @KumbongHermann, and advisor @Azaliamirh 🌟!

[Soham Konar @sohamkonar_]

@sahiladhawade i nominate @vrushaaank @siddrrsh @w41tz @aniketh_iyengar @ishanskhare @mihiranand @bar_weiner

[Soham Konar @sohamkonar_]

@rovirmani @top_jeet_ yeah man i’m really missing out

[Soham Konar @sohamkonar_]

@rovirmani @top_jeet_ i’m good bro

[Soham Konar @sohamkonar_]

@akvbell that’s why when i travel i wear a hat that covers my ears

[Soham Konar @sohamkonar_]

@sahiladhawade @ShrayAlag “write a tweet about how good ollama is in the style of @sahiladhawade’s tweets”

[Soham Konar @sohamkonar_]

@sahiladhawade

[Soham Konar @sohamkonar_]

@sairahul1 i would like to nominate ambientGPT by @siddrrsh for this list, it would easily be a top 10 product on this list

[Soham Konar @sohamkonar_]

@siddrrsh Great work! Does it work across multiple monitors? Could be a game changer if so

[Soham Konar @sohamkonar_]

@thewilliampan i fully agree but counter: if you advertise only what you know and nothing more, it is much harder to get your foot in the door to somewhere (eg. groundbreaking companies and startups) where you can actually gain the knowledge and experience to walk the walk

[Soham Konar @sohamkonar_]

the biggest skill one can have today is to be a "dinner party conversationalist". it’s the only way to get ahead in this rat race

[Soham Konar @sohamkonar_]

@ishanskhare this is what separates the great from the best. when i think of the word "clutch", only one name comes to mind: @siddrrsh

[Soham Konar @sohamkonar_]

@MichaelDNath @siddrrsh i’m just calling it as i see it

[Soham Konar @sohamkonar_]

@AllenNaliath @emilyzsh @sama you could get it lightly engraved but the only issue is that the metal is so thin and the components underneath are so sensitive that it might cause damage. maybe finding a way to stain the metal underneath could be the move

[Soham Konar @sohamkonar_]

@ShrayAlag @sahiladhawade @PhilzCoffee @siddrrsh on the other hand, @siddrrsh can flip a switch and context switch so fast that momentarily, he becomes the only person to ever achieve true multiprocessing on human hardware. hard to tell which state hes in sometimes because either way, hes wired in

[Soham Konar @sohamkonar_]

@sahiladhawade @PhilzCoffee if you can’t achieve flow state sitting on your floor mattress then are you even a true builder?

[Soham Konar @sohamkonar_]

@siddrrsh the issue here is even if you implement these papers, only the companies with major backing can actually train these models and get the fruits of their labor, enabling them to repeat the process; it’s a positive feedback loop that keeps the common man out of the race

[Soham Konar @sohamkonar_]

@ishan_k21 revolutionary work from one of Stanfords best, welcome to the builder space here on X, happy to have you #gmi