Top Tweets for #DistributedTraining
A deep dive into the hidden machinery behind distributed LLM training.
#dataparallelism #distributedtraining...Show more
504대 규모 B200 GPU 클러스터의 LLM 학습 장애 탐지와 자동 복구 운영 분석 (feat. Lablup)
(by 9bow님)
https://t.co/gBg82MKr5c
#paper #llm #technicalreport #lablup #distributedtraining #checkpoint #gpucluster
Hiring now: Distributed Training Engineer, Sora
Apply ➜ https://t.co/zAlP58U792
OpenAI
📍 San Francisco
💰 Salary negotiable
#distributedtraining #openaijobs #hiring #jobsearch #techjobs
Qwen3.6 27B is here. NeMo AutoModel support is ready on day0! 🚀
Fine-tune Qwen3.6-27B out of the box with an end-to-end validated recipe: https://t.co/ItD3jwnaFB
Day-0 support means when new models land, you’re already training ⚡️
#NeMo #LLM #Qwen #DistributedTraining
Join @clockworkio & @linuxfoundation for a free live webinar TOMORROW at 9:00 AM PT: "Handling Hardware Failures During Training: A Comparative Analysis of Fault Tolerant Training Frameworks". Learn more & register: https://t.co/IemTronvpP #OpenSource #Linux #DistributedTraining #FaultTolerance #MLInfrastructure #MLOps
🚀 Mistral Small 4 is now supported in NeMo-AutoModel, NVIDIA’s PyTorch DTensor/SPMD training library with parallelism + day-0 Hugging Face workflows.
Scale-ready EP+PP recipe on 4 nodes × 8×H100
https://t.co/9D3iIjb35S
#NeMo #PyTorch #Mistral #LLM #DistributedTraining
Even if you can't make it to the talk or the course and are attending GTC, DM me! Hyped for everything that is to come!!
🧷 Register: https://t.co/OlAWcogEgD
See you in San Jose! March 16-19.
#GTC26 #NVIDIA #DistributedTraining #NVRx #NeMo #AI #FaultTolerance #NVIDIAGTC
Learn how to provision a multi-node GPU training cluster on @CrusoeAI with Terraform - specifically a 2-node A100 setup with InfiniBand: https://t.co/8J9nZ9u59m
#DistributedTraining #Terraform #MLOps #Crusoe
Communication is often the bottleneck in distributed AI.
Gensyn’s CheckFree offers a fault-tolerant pipeline method that yields up to 1.6× speedups with minimal convergence loss.
@gensynai
#AI #DistributedTraining
📚 New 2-part series: Beyond GPUs
🔹 Part 1: foundations (5-D parallelism, checkpointing)
🔹 Part 2: scaling hacks (ZeRO, FlashAttention, FP8)
👉 https://t.co/14kr8fIPTp
#LLM #DeepLearning #AI #HighPerformanceAI #DistributedTraining #FlashAttention #MixedPrecision
Distributed Training: Train massive AI models without massive bills! Akash Network's decentralized GPU marketplace cuts costs by up to 10x vs traditional clouds. Freedom from vendor lock-in included 😉
#MachineLearning #DistributedTraining #CostSavings
$AKT $SPICE
Train large language models in a shared and sustainable way? Join #Bittensor subnet 38 #DistributedTraining and start mining #Tao.
✅ Achievement Unlocked! Efficient #DistributedTraining of DeepSeek-R1 671B is now a reality on #openEuler 24.03! 💙 Dive in and see what this #TechCP, openEuler + #DeepSeek, bring to the table 👉https://t.co/nelLyHK5FF #opensource #ValentinesDay2025 #ValentinesDay #openEulerBuzz
✅ Achievement Unlocked! Efficient #distributedtraining of #DeepSeek-R1:671B is realized on #openEuler 24.03! Built for the future of #AI, openEuler empowers #developers to push the boundaries of innovation. 🐋Full technical deep dive coming soon!
@deepseek_ai
#opensource #LLM
https://t.co/TxEzPV22df
Kooltek68 #FLock Training Node:
We are happy to introduce our next work as #LLM Tranining Node for @flock_ioflock_io .
We believe in #decentralizedAI and with #federatedlearning in #zeroknowledge mechanism, we will make #distributedtraining happen.
Please support us via stake / delegate to this address:
0x2b0b6bc394dbf1953b99bb90a7d51b15801f4127
Much Appreciated 😍
Distributed training just got easier on Outerbounds! Now generally available, it supports multi-GPU setups with [@]torchrun and [@]metaflow_ray. Perfect for large data and models. Train efficiently, even at scale! 💡 #AI #DistributedTraining
![OuterboundsHQ's tweet photo. Distributed training just got easier on Outerbounds! Now generally available, it supports multi-GPU setups with [@]torchrun and [@]metaflow_ray. Perfect for large data and models. Train efficiently, even at scale! 💡 #AI #DistributedTraining https://t.co/ARXgXyhOO4](https://pbs.twimg.com/media/GX2qQi9WcAALkzc.jpg)
Data from block 3849132 (a second ago)
---------------
💎🚀 Subnet32 emission has changed from 2.587461% to 2.5954647%
#bittensor #decentralizedAI #distributedtraining $tao
#subnet @ai_detection
🔥 Scaling LLMs with Distributed Training: Learn how data and model parallelism techniques maximize the resource utilization and reduce training costs. #MachineLearning #DistributedTraining #DataParallelism #ModelParallelism 🔥 https://t.co/XwkfwFpQjX
Day 27 of #100DaysOfCode: 🌟
Today, I coded for Distributed Training! 🖥️
🔄 Even without multiple CPUs, I learned how to scale deep learning models across devices.
Excited to apply this knowledge in future projects!
#DistributedTraining #DeepLearning #AI
Researchers introduce Perseus, a framework reducing energy bloat in large-scale ML and AI training by up to 30%
#AI #AIframework #artificialintelligence #CarbonFootprint #Computationalresources #distributedtraining #energyconsumption
https://t.co/0AynmGJ3iz
Last Seen Hashtags on Sotwe
ขวัญใจคุณหนูแม่ยก
wankchat
Seen from Germany
명작추천
Seen from United States
DESICOUPLE
minichats
Seen from Norway
varsello
Seen from Italy
sister and brother
Seen from Pakistan
incesto real
Seen from Italy
momson() + filter:videos since:2026-03-03 until:2026-03-05
Seen from United States
น้องนักบอล
Seen from Thailand
Trends for you
Most Popular Users
Elon Musk 
@elonmusk
241M followers
Barack Obama
@barackobama
118.8M followers
Cristiano Ronaldo
@cristiano
114.5M followers
Donald J. Trump
@realdonaldtrump
111.9M followers
Narendra Modi
@narendramodi
107M followers
Rihanna
@rihanna
98.7M followers
NASA
@nasa
92.2M followers
Justin Bieber
@justinbieber
91.8M followers
KATY PERRY
@katyperry
90M followers
Taylor Swift
@taylorswift13
84M followers
Lady Gaga
@ladygaga
75.5M followers
Virat Kohli
@imvkohli
73.4M followers
Kim Kardashian
@kimkardashian
70.8M followers
YouTube
@youtube
68.7M followers
Neymar Jr
@neymarjr
66.4M followers
Bill Gates
@billgates
65.2M followers
Selena Gomez
@selenagomez
63.1M followers
The Ellen Show
@theellenshow
62.2M followers
CNN
@cnn
61.7M followers
X
@x
60.6M followers