Top Tweets for #OSDI24
In an hour, @ShubhaSudipta will present our work on resource optimized ML inference by avoiding GPU interference at @usenix #osdi #osdi24. If you're around, please attend the talk and ask him about our work!
Proud advisor moment #osdi24. @zhong_yuhong presented our work on managing CXL in virtualized cloud environments
Talk to @agrawalamey12 or @nitinkedi at #osdi24 to learn more about our recent work Sarathi-Serve, a scheduler that addresses the latency-throughput tradeoff in LLM serving.
Did you ever feel that @chatgpt is done generating your response and then suddenly a burst of tokens show up? This happens when the serving system is prioritizing someone else’s request before generating your response. But why? well to reduce cost. 🧵
This Friday at @usenix #OSDI24, @sijun_tan & I will be giving a talk about how to deploy multi-party cryptographic systems on-demand with Flock!🪶
Excited to share our @usenix OSDI '24 paper "Flock🪶: A Framework for Deploying On-Demand Distributed Trust" with @sijun_tan @praveingk @ralucaadapopa.
We answer what multi-party cryptographic systems take for granted: Who are the non-colluding parties? https://t.co/5k4QpVkvMJ👇
LLM serving is HOT at #ATC24 #OSDI24 this year! 12 papers on the topic (a 500% increase from 2023), including our work on power/energy-aware LLM serving. Thrilled to present and engage in discussions on this rapidly evolving field. Don't miss out! 🚀
#llmserving #LLMs
Super excited to hear about the #OSDI24 accpetance!
Thanks @haozhangml for great mentorship, and also my great pleasure working with @YinminZhong and team.
🎉 Excited to announce that our paper DistServe was accepted to #OSDI #OSDI24!
Congrats to our great team: @YinminZhong , Shengyu Liu, @Junda_Chen_, Jianbo Hu, Yibo Zhu, Xuanzhe Liu, Xin Jin, @haozhangml
🎉 Excited to announce that our paper DistServe was accepted to #OSDI #OSDI24!
Congrats to our great team: @YinminZhong , Shengyu Liu, @Junda_Chen_, Jianbo Hu, Yibo Zhu, Xuanzhe Liu, Xin Jin, @haozhangml
Still optimizing throughput for LLM Serving?
Think again: Goodput might be a better choice!
Splitting prefill from decode to different GPUs yields
- up to 4.48x goodput
- up to 10.2x stricter latency criteria
Blog: https://t.co/pVNpYbR7Qq
Paper: https://t.co/n47rFkMZS0
Our system ServerlessLLM got accepted into #OSDI24! This system features a new LLM checkpoint format, multi-tier LLM loader, inference live migration, and more! This work is led by Yao Fu. Joint with Leyang, Yeqi, Andrei, @DmitriiUstiugov, and Yuvraj. Congratulations on the team!
Our work on avoiding GPU interference for achieving resource optimized ML inference has been accepted to appear at #osdi #osdi24! Joint work with awesome folks @ShubhaSudipta and HaiyingShen!
The Preliminary Call for Papers for the 18th USENIX Symposium on Operating Systems Design and Implementation (OSDI '24) is now available: https://t.co/AHNsgflk6L #osdi24
Last Seen Hashtags on Sotwe
รับงานบรรพตพิสัย
Seen from Thailand
bursatravesti
Seen from Turkey
โชว์แฟน
Seen from Thailand
lomotif vazados
Seen from Canada
landscapes
Seen from United States
zenci sert
Seen from Turkey
monkeyapp
Seen from New Zealand
madre amigo
Seen from Dominican Republic
人前全裸
Teenage video*
Seen from Germany
Trends for you
Most Popular Users
Elon Musk 
@elonmusk
240.7M followers
Barack Obama
@barackobama
119.2M followers
Donald J. Trump
@realdonaldtrump
111.7M followers
Cristiano Ronaldo
@cristiano
111M followers
Narendra Modi
@narendramodi
107M followers
Rihanna
@rihanna
97.7M followers
NASA
@nasa
92.2M followers
Justin Bieber
@justinbieber
91M followers
KATY PERRY
@katyperry
87.9M followers
Taylor Swift
@taylorswift13
81.7M followers
Lady Gaga
@ladygaga
73.2M followers
Virat Kohli
@imvkohli
70.2M followers
Kim Kardashian
@kimkardashian
69.9M followers
YouTube
@youtube
68.7M followers
Bill Gates
@billgates
64M followers
Neymar Jr
@neymarjr
63M followers
The Ellen Show
@theellenshow
62.4M followers
CNN
@cnn
61.9M followers
Selena Gomez
@selenagomez
60.9M followers
X
@x
60.8M followers