Hut

[Hut @hut_]

By optimizing how process memory and GPU state travel together:
🧠 Decoupled model weights via a GPU Memory Service
✂️ Shrunk checkpoints by dynamically freeing physical KV cache pages
⚡ Patched CRIU with parallel memfd restore & Linux native AIO
https://t.co/dCcsjeFTZ1

[Hut @hut_]

Scaling LLM inference replicas elastically on Kubernetes usually means brutal cold starts. My team and a large group of engineers across NVIDIA just launched NVIDIA Dynamo Snapshot https://t.co/dCcsjeFTZ1 to solve this—slashing gpt-oss-120b restore times down to under 5 seconds.

[Pavlo Molchanov @PavloMolchanov]

We’re releasing Nemotron-Labs-Diffusion - the first Tri-mode LM family (3B/8B/14B) that switches between 1⃣Autoregressive, 2⃣Diffusion, and 3⃣Self-Speculation decoding by simply changing the attention pattern/mask.

One model Three decoding modes. No extra draft models. No architecture changes. Just significantly better efficiency across different concurrency levels.

Up to 4× higher real throughput for a single user.

🤗 HF Collection: https://t.co/1zStcCCWPi, open license
🛜 Project page: https://t.co/y6TEAvLFvD
📰 Tech report: https://t.co/NSjKxEyHnT

Details below 👇

[AI at Meta @AIatMeta]

The stable release of @PyTorch 1.0 is here! A big thank you to the community that's formed around #PyTorch and to those contributing with code, feedback, or new projects. Learn how to get started here: https://t.co/GX8poSLL6o

[Hut @hut_]

Сёння — моцная спёка: у Мінску будзе да +33 градусаў https://t.co/rt9gWyGbGA

[Hut @hut_]

alias nfsmount='mount -t nfs -o "auto,noatime,nolock,intr,tcp,actimeo=1800" 10.0.1.3:/var/nfs ${HOME}/nfs'

[Hut @hut_]

My adventures: America http://t.co/QhtP8Inv

[Hut @hut_]

finally got PhD!

[Hut @hut_]

@bykau да, Деня молодец - у видео достойная идея

[Hut @hut_]

очень многое из того, что называют современным искусством сложно назвать словом "искусство, ибо оно не взывает к чувствам

[Hut @hut_]

все супер!

[Hut @hut_]

французы - те же итальянцы: нихрена на знают английского

[Hut @hut_]

44 дополнительных композиции от queen, carole king и zweieck для новых тестов chord recognition!

[Hut @hut_]

Normalized cross-correlation for periodicity detection

[Hut @hut_]

@camomile_: бум теперь на факультет педалить

[Hut @hut_]

мега-пиво с мега-опозданием мега-мексиканцев

[Hut @hut_]

@camomile_ супер! поздравляю! надеюсь тот плоттер выживет...

[Hut @hut_]

@tivalex Ф. реально заценил мою рекомендацию о тебе :)

[Hut @hut_]

баня. очищение тела.

[Hut @hut_]

@gnomenat: клева тебе, всегда мечтал попасть на ниагару