Over the next few days, I’d like to share 35 things I learned before 35. Some lessons came late, but they came regardless and sharing doesn’t hurt because we don’t learn these lessons at the same time. That’s the beauty of this journey called life.
Like the insecurity in naij is not bad enough. The posting of fake clips for engagement, falsifying stuff, rage baiting and more is just ridiculous.
Real people are being abducted and killed, but people just doing all sorts
@keennay@TheAhmadOsman@vllm_project@lmsysorg I noticed this gap too. I'm actually trying to hire a PM to focus on this so we can put more focus on it. If anyone knows of a good referral, please send them my way! https://t.co/3SnczukReS
The issue extends beyond the NVIDIA product team. Newer launches often hold day 0 @vllm_project & @lmsysorg SGLang support across Hopper & Blackwell datacenter GPUs, including their inference cookbook recipes, without much consideration for the SM120 ecosystem of RTX 5090 & RTX Pro 6000 GPUs
The culture prioritizes H100 / H200 / B200 / B300 deployments since that's where the big money is, yet local LLM runners are often left unsupported with forked workarounds. A good chunk of models run without issue, Nemotron 3 Ultra 550B NVFP4 in particular, whereas GLM 5 & DeepSeek V4 Flash ran into their own set of problems
Here's a list of the initial limitations for GLM 5 / 5.1 on SM120 through vLLM, with eventual workarounds with the B12X backend. The screenshot was taken from the RTXPro6k Discord community
@TheAhmadOsman Wait what's the issue? Give me the info I can look into this.
Our model optimizations targets for vLLM include RTX 6000. What model is not behaving correctly?
Guys, just a reminder that WE ALL have to speak up and ask NVIDIA to put more effort & focus on the sm120 and sm121
I am just like you annoyed with this situation for the RTX PRO 6000s and DGX Sparks
But I also believe if we all voice this they'll hear us & do the right thing
If you come across this on your timeline, kindly help with a repost. I still need brand collaborations. Suggestions, referrals, and introductions would also be greatly appreciated.
If OpenAI or Anthropic were crypto projects with tokens, so many regular people would have been super set for life.
Good luck on the IPO though. A few people who are already sorted, will just be more sorted.
Took a drive with my dad yesterday and spent about 3 hours sitting down and just talking about life.
I’m fortunate to have these moments and I appreciate my parents for real.
LAGOS NIGERIA!
I’m announcing my first ever headline shows here, and we have made sure this homecoming will be special. Sign up for early access here! https://t.co/6RTJy6ubeT