#LLMServing - Twitter Hashtag

6 months ago

📺 Watch recordings on YouTube: https://t.co/xw6ij5Q0T0 👉 Full text recap: https://t.co/ppz7b4xP0s #SGLang #VLM #MultimodalAI #LLMServing #OpenSource

0

2

0

2

990

Ivan Nardini

@ivnardini

8 months ago

🔥 Benchmarking a new optimization integrated by the Model Garden team for serving LLMs on Vertex AI. Can't wait to share! #VertexAI #LLMs #Benchmarking #Optimization #ModelGarden #LLMServing

ivnardini's tweet photo. 🔥 Benchmarking a new optimization integrated by the Model Garden team for serving LLMs on Vertex AI.

Can't wait to share!

#VertexAI #LLMs #Benchmarking #Optimization #ModelGarden #LLMServing https://t.co/RDx3KSeC6m

0

4

0

1

241

Amii @0xAmiii

about 1 year ago

🚨AI pros, ML engineers, and model trainers, pause for a sec! I just dug into @hyperbolic_labs 's latest blog on LLM serving frameworks, and it’s packed with insights for scaling AI. Let’s dive in! 🧵👇 #AI #MachineLearning #LLMServing #Tech

0xAmiii's tweet photo. 🚨AI pros, ML engineers, and model trainers, pause for a sec!
I just dug into @hyperbolic_labs 's latest blog on LLM serving frameworks, and it’s packed with insights for scaling AI. Let’s dive in! 🧵👇
#AI #MachineLearning #LLMServing #Tech https://t.co/XRqoZjKU0V

10

14

0

103

Dynamiq

@DynamiqAGI

over 1 year ago

@DynamiqAGI has officially integrated with @SambaNovaAI, enabling lightning-fast LLM serving at 1,000 tokens per second for Llama 3.1 8B ⚡️ Even better, this powerful solution comes with on-premise hosting options 🔒 #LLMserving #Dynamiq #SambaNova #OnPremise

DynamiqAGI's tweet photo. @DynamiqAGI has officially integrated with @SambaNovaAI, enabling lightning-fast LLM serving at 1,000 tokens per second for Llama 3.1 8B ⚡️ Even better, this powerful solution comes with on-premise hosting options 🔒
#LLMserving #Dynamiq #SambaNova #OnPremise https://t.co/blnaoyLyYv

0

2

1

0

244

Haoran Qiu @haoran_qiu98

about 2 years ago

LLM serving is HOT at #ATC24 #OSDI24 this year! 12 papers on the topic (a 500% increase from 2023), including our work on power/energy-aware LLM serving. Thrilled to present and engage in discussions on this rapidly evolving field. Don't miss out! 🚀 #llmserving #LLMs

1

10

0

2

1K

Top Tweets for #LLMServing

Last Seen Hashtags on Sotwe

Trends for you

Most Popular Users