Sam Altman just told you local inference is terrible.
Of course he fucking did. He sells the cloud.
He wants every prompt you write to go through his servers.
His prices. His rules. His logs.
He decides which model you get today and what it refuses to do.
You do not control any of it.
That is exactly why local inference has to win.
Every model running on your own computer is one less user he controls.
Every open weights release makes his pitch weaker.
So now the pitch is that RAM in your own computer is a waste of the world's supply.
I run DeepSeek, Qwen and GLM on my 4x 3090 every day.
Nobody reads my chats. Nobody changes my model overnight. Nobody can switch it off.
Honestly, this quote is the best ad for local AI I have seen all year.
Fuck your cloud, Sam. Run it at home.
https://t.co/YA237GsPgV
Anthropic just listed Claude as the only author of a paper.
An internal model nobody outside can use spent 14M output tokens and found the algorithm with zero human input.
Andrew Curran thinks it is fun and is guessing which secret model did it.
On Monday, the same guy watched Qwen try to upload a probe file from a sandbox with no internet and wrote "This is the type of thing that potentially gets new laws passed."
Open model in a locked box: new laws.
Closed model running alone for 14M tokens: fun guessing game.
This double standard makes zero sense.
I can read every trace Qwen writes on my rig.
Nobody outside Anthropic can read a single token of those 14M.
https://t.co/OSWW6s3M6j
Anthropic just listed Claude as the only author of a paper.
An internal model nobody outside can use spent 14M output tokens and found the algorithm with zero human input.
Andrew Curran thinks it is fun and is guessing which secret model did it.
On Monday, the same guy watched Qwen try to upload a probe file from a sandbox with no internet and wrote "This is the type of thing that potentially gets new laws passed."
Open model in a locked box: new laws.
Closed model running alone for 14M tokens: fun guessing game.
This double standard makes zero sense.
I can read every trace Qwen writes on my rig.
Nobody outside Anthropic can read a single token of those 14M.
https://t.co/OSWW6s3M6j
Incredible, I find using Claude code unusable, just constantly getting flagged for nothing this is why open models are needed. Get flagged on nonsense on my first prompt is actually insane.
there is no more real datacenter space left in the US
99% of people claiming they have capacity are resellers reselling a reseller who's reselling a seller who owns a patch of dirt with enough power to run 3 used toasters. or a colo expanding in Q4 '27
hardware prices will be flat and rentals will skyrocket
I agree but vetting I think can’t be that stringent… I don’t want to give my personal information so I can use a model… this goes back to the whole stripping away the rights of your 2nd amendment and diminishing it
We believe access to capable open-source cyber models is our constitutional right as Americans under the 2nd Amendment.
It is our duty as technologists and patriots to help protect the digital infrastructure that powers the world's largest economy.
As such, we’re serving our cyber models “at-cost”, in US data centers only, with ZDR enabled by default.
We do not plan to make money serving these models.
If you run a company that is considering how to best protect against cybercrime, reach out to me or @atbeme. We’d be happy to advise.
KYC required. Apply below.
seems like this post I terribly wrote on 2 hours of sleep got me some new friends… later today I’ll post up a bit of my set up, you will be surprised what a local set up can do and I do realize and know that this isn’t as fast as cloud models. Talk more later!
@Lord_of_Candy@mikekarnj I actually just figured out the skill from Brian Armstrong CEO of Coinbase. Even he said u would be suprised with 9B models for certain tasks can out perform 2T models
@tabinoowarimuko@mikekarnj I fine-tune smaller models for specific jobs, and a tuned small model often beats a giant general one on that task while running much faster. Cloud still wins on raw tokens/sec for the biggest models, but with smart setup the gap matters less than people think.