Top Tweets for #DeepSparse
The latest #MLPerf inference results are in and they show #DeepSparse providing ~50x improvements over baseline BERT-Large reference implementation on both AWS ARM and GCP x86 instances.
See how and replicate our results today: https://t.co/ZOjQkndxLQ
๐ Exciting AI news from @neuralmagic! Optimize large language models effortlessly with our software and deploy them on commodity CPUs using #DeepSparse for lightning-fast inference.
Unleash unparalleled performance, scalability, and cost efficiency. And get to deployment (market!) way faster.
Discover the benefits of CPU deployments and propel your AI infrastructure to new heights.
Learn more and get started by reading our blog: https://t.co/2XHt2MTZDK
#AI #ML #SparseGPT
Here's the best part.
In 22 days, on May 25th, @markurtz_ and @DAlistarh will show you how you can download already-optimized, open-source LLMs from the #SparseZoo and run them on CPUs at GPU speeds and better using #DeepSparse.
Confirm your spot: https://t.co/rwZy7pvbl7
Did you lose an hour of sleep due to #DaylightSavingTime?
Donโt worry, you can get it back using Neural Magic ๐
1/ #SparseZoo - prototype from already-optimized ML models
2/ #SparseML - apply your data with a few lines of code
3/ #DeepSparse - run ML in deployment super fast
Deploy #Serverless #MachineLearning Inference on #AWS #Lambda with #DeepSparse #docker
https://t.co/MIA77t7AxP
We carried a 4-core laptop around Boston, comparing runs of sparsified #YOLOv5 object detection model running on the #DeepSparse Engine and #ONNXRuntime.
End result: Pruning + INT8 quantization = 10x faster and 12x smaller model.
Replicate our results: https://t.co/tc9hu1yaiF
We carried a 4-core Lenovo Yoga laptop around our home city of Boston (again!), now comparing runs of sparsified #YOLOv5 object detection model running on the #DeepSparse Engine and #ONNXRuntime.
TL;DR: Pruning + INT8 quantization = 10x faster and 12x smaller YOLOv5 model.
#DeepSparse Engine, a CPU runtime that delivers GPU-class performance by taking advantage of #sparsity within neural networks to reduce compute required as well as accelerate memory bound workloads. #DeepLearning #Python #OpenSource
https://t.co/0xmoWLlbQC
Last Seen Hashtags on Sotwe
Most Popular Users
Elon Musk 
@elonmusk
240.2M followers
Barack Obama
@barackobama
119.3M followers
Donald J. Trump
@realdonaldtrump
111.6M followers
Cristiano Ronaldo
@cristiano
109.1M followers
Narendra Modi
@narendramodi
107M followers
Rihanna
@rihanna
97.3M followers
NASA
@nasa
92.1M followers
Justin Bieber
@justinbieber
90.6M followers
KATY PERRY
@katyperry
86.9M followers
Taylor Swift
@taylorswift13
80.7M followers
Lady Gaga
@ladygaga
72.3M followers
Kim Kardashian
@kimkardashian
69.4M followers
Virat Kohli
@imvkohli
68.7M followers
YouTube
@youtube
68.6M followers
Bill Gates
@billgates
63.5M followers
The Ellen Show
@theellenshow
62.5M followers
CNN
@cnn
61.9M followers
Neymar Jr
@neymarjr
61.2M followers
X
@x
60.9M followers
Selena Gomez
@selenagomez
60M followers