Marshall Choy

NorCal original | My opinions

[Marshall Choy @MarshallChoy]

🔥 Pre-IPO Funding | New Systems | Global Expansion | R&D Advancement 🎉

[Rebellions Inc @Rebellions_inc]

We just raised $400M and launched two new products.

But the more interesting story is why inference infrastructure is the hardest problem in AI right now – and how we're approaching it.

[Marshall Choy @MarshallChoy]

The @Rebellions_inc team is at @Supercomputing this week, ready to discuss AI inferencing at supercomputer-scale. Looking forward to catching up with everyone at the show!

#sc25 #hpcignites #top500 #top500list #ai #genai #agentic

[Marshall Choy @MarshallChoy]

I’m thrilled to join the amazing @Rebellions_inc to lead their global expansion!
#ai #genai #silicon #moe #llm

[Rebellions Inc @Rebellions_inc]

We are excited to welcome Marshall Choy as CBO and Jennifer Glore as EVP of Product Management at Rebellions!
With their leadership, we are ready to accelerate global growth and push AI forward in a more efficient and accessible way. 🌎

[Marshall Choy @MarshallChoy]

Heading to @Supercomputing to meet with our customers and partners to discuss the fastest generative AI and most efficient agentic systems from @SambaNovaAI

https://t.co/jDXXFrkDFe

#ai #genai #agentic #hpc #sc24 #
#supercomputing #top500 #top500list

[Marshall Choy @MarshallChoy]

Chart topping world record performance for Llama 3.1 70B instruct inference by @SambaNovaAI

#ai #genai #llm #performance #Llama

[Marshall Choy @MarshallChoy]

@sallywf @SambaNovaAI Stop by anytime, @sallywf! It was great to catch up.

[Marshall Choy @MarshallChoy]

Great to see you’re having fun with @SambaNovaAI’s API @AndrewYNg. Thanks for the shoutout!

#ai #genai #api #inference #developers

[Andrew Ng @AndrewYNg]

I've been playing with @SambaNovaAI's API serving fast Llama 3.1 405B tokens. Really cool to see leading model running at speed. Congrats to Samba Nova for hitting a 114 tokens/sec speed record (and also thanks @KunleOlukotun for getting me an API key!) https://t.co/GuBfYsfizJ

[Marshall Choy @MarshallChoy]

@SambaNovaAI @genaisummitsf Developers, developers, developers!

[Marshall Choy @MarshallChoy]

@IanCutress Yep, 16!

[Marshall Choy @MarshallChoy]

@dee_alvara25236 @SambaNovaAI Top of the chart according to data published by @ArtificialAnlys

[SambaNova @SambaNovaAI]

🚀🌟🚀Excited to announce Samba-CoE v0.2, which outperforms DBRX by @DbrxMosaicAI and @databricks, Mixtral-8x7B from @MistralAI, and Grok-1 by @grok at a breakneck speed of 330 tokens/s.
These breakthrough speeds were achieved without sacrificing precision and only on 8 sockets, showcasing the true capabilities of dataflow! Why would you buy 576 sockets and go to 8 bits when you can run using 16 bits and just 8 sockets. Try out the model and check out the speed here - https://t.co/A3lB3RTEo2.

We are also providing a sneak peak of our next model, Samba-CoE v0.3, available soon with our partners at @LeptonAI. Read more about this announcement at https://t.co/DIiuJkPlKg

[Marshall Choy @MarshallChoy]

@matteastwood How does the King of Rock ‘n’ Roll not make the list?

[Marshall Choy @MarshallChoy]

Thanks so much Honorable Consul General Chue for your hospitality and for sharing your vision for transatlantic technology and business alignment.

#ai #hpc #ISC23 #usa #europe @usconshamburg @SambaNovaAI

[Marshall Choy @MarshallChoy]

Enterprise Automation 2.0 keynote by @RituJyoti at @IDC Directions starting now!

#GenerativeAI #idcdirections #transformation #enterprise

[Marshall Choy @MarshallChoy]

“Foundation models are enabling many of these breakthrough AI capabilities that are delivering value that was not previously possible” - @RodrigoLiang, cofounder and CEO @SambaNovaAI

#GenerativeAI #deeplearning #ai #foundationmodels

https://t.co/P0RYWOGirk

[Marshall Choy @MarshallChoy]

Scaling-up with a big @SambaNovaAI gen2 deployment at @argonne_lcf

#sc22 #ai #deeplearning #hpc

SambaNova delivers next-generation DataScale system to Argonne National Laboratory https://t.co/XjtDuJayrI

[Marshall Choy @MarshallChoy]

Amazing new research from the @argonne_lcf team, proud @SambaNovaAI could be a part of it.

#ai #deeplearning #sc22

[ALCF @argonne_lcf]

In a new study in @ScientificData, @argonne researchers leveraged ALCF's ThetaGPU (@nvidia) and @SambaNovaAI systems to showcase how to create and share FAIR #AI models within a unified computational framework.

Story: https://t.co/LYoCAChTp5

Paper: https://t.co/pyfiFvu4xa

[Marshall Choy @MarshallChoy]

Great research by the @SLAClab team targeting an encoder-decoder network as a demonstrating case for ML training acceleration on @SambaNovaAI

#ai #deeplearning #hpc
https://t.co/0C8kmvbpMm

[Marshall Choy @MarshallChoy]

@NicoleHemsoth Hope to see you there!

[Marshall Choy @MarshallChoy]

Thanks for the great coverage @sallywf

#ai #nlp #deeplearning #foundationmodels @SambaNovaAI

[Sally Ward-Foxton @sallywf]

.@SambaNovaAI 2nd-gen silicon is bigger and better than the 1st, with 640MB on-chip memory, 1TB direct-attached DDR in package, 688 TFLOPS of compute (for BF16), two chiplets still on TSMC 7nm... details, plus a rundown of new foundation models trend:
https://t.co/3RhbJ1bu6W