Stephen Roller

MTS @thinkymachines. previously pre-training @googledeepmind, @character_ai, and @aiatmeta.

[Stephen Roller @stephenroller]

@DavidSHolz why do people compare ray and slurm ever

[Nick Davidov @Nick_Davidov]

The biggest bullshit move by DHS in its history. So everyone on a O1 or H1B visa would have to stop working legally in the US, go back to their country and wait for years of backlog? This includes top scientists in our universities, founders of billion dollar companies (at least 3 just in our portfolio would be affected by the way). And if we look at individual countries it becomes even more bs. Indians would have to wait decades. Russians don’t have anywhere to go (there is no US embassy in Russia, hello?).

This is the worst imaginable way to disrupt important work for the country and pretend you’re fighting some loophole.

[Cute @cutecorestar]

.

[Soumith Chintala @soumithchintala]

Cluster magicians and GPU whisperers, come join us!

We’re looking for supercomputing engineers to build the infrastructure behind real-time interactive models, Tinker, and large-scale training: scheduling, storage, networking, reliability, and distributed systems at scale.

Hiring in NYC and SF
https://t.co/jCx00R6UvB

[Stephen Roller @stephenroller]

@willdepue `caffeinate -s`

[Thinking Machines @thinkymachines]

People talk, listen, watch, think, and collaborate at the same time, in real time. We've designed an AI that works with people the same way.

We share our approach, early results, and a quick look at our model in action.

https://t.co/AFJZ5kH7Ku

[地獄ケーキ(Hokusaist)👹🐉🗡️🇺🇸 @JigokuCake]

This is the kind of shit Godspeed You! Black Emperor would use as an album cover with a title like "And the Holy Flame Blinded us for 333000 Years Pt. II"

[Stephen Roller @stephenroller]

@BeidiChen imho hash layers are the logistic regression of routers — a surprisingly strong baseline that you absolutely must beat

[Stephen Roller @stephenroller]

Didn't have hash layers on my bingo card

[DeepSeek @deepseek_ai]

🚀 DeepSeek-V4 Preview is officially live & open-sourced! Welcome to the era of cost-effective 1M context length.

🔹 DeepSeek-V4-Pro: 1.6T total / 49B active params. Performance rivaling the world's top closed-source models.
🔹 DeepSeek-V4-Flash: 284B total / 13B active params. Your fast, efficient, and economical choice.

Try it now at https://t.co/GCdiMzk1Dl via Expert Mode / Instant Mode. API is updated & available today!

📄 Tech Report: https://t.co/drlDrxkYtp
🤗 Open Weights: https://t.co/T13Y8i7SDM

1/n

[Jason Weston @jaseweston]

DeepSeek-V4 uses our Hash routing approach developed back in 2021 -- see screenshot of their tech report! (Looks like a great model, congrats!)

Bonus note: our same blogpost (& paper) back in 2021 also introduced 'looped transformers', but we called that staircase & ladder (see screenshot): https://t.co/widkeEXz56

https://t.co/PQLdPKg9PS

[Jacob van Gogh @JayArrVeeGee]

me: Make me the most AI slop image that ever AI slopped. The pinnacle of slop. A seminal work on AI slop.

ChatGPT Images 2.0:

[Tinker @tinkerapi]

Long context windows are now available for select models on Tinker!
- 128k tokens for Kimi K2.5 and GPT-OSS-120B
- 256k for Nemotron 3 Super 120B and Qwen3.5 397B.
For more details and pricing, see our full model lineup: https://t.co/TJNW8oePUF

[Stephen Roller @stephenroller]

@bcherny cruel april fools day joke

[Brydon Eastman @brhydon]

I heard ASL-5 is when the Claude code TUI stops flickering in tmux

[Cameron 🇺🇸 🗽🦅 @CameronCorduroy]

this is what actual national suicide looks like btw

[Matthew Leavitt @leavittron]

I couldn't agree more. This is exactly why we founded @datologyai

[Mira Murati @miramurati]

Grateful to Jensen and @nvidia team for their support. Together, we’re working to deploy at least 1GW of Vera Rubin systems, bringing adaptable collaborative AI to everyone.
https://t.co/FiOL7SRbut

[Eric Zhang @ekzhang1]

times are hard. had to teach an AI researcher how to use kubernetes today

[Larissa Schiavo @lfschiavo]

things are gonna get weird. you must get commensurately weird.