if you're a business owner just picking the smartest model doesn't matter anymore.
what you really need is to stop relying on just one... Here is the org chart for your AI 🧵
If the US can lead in open source, that will meaningfully change the direction we are going towards as a society.
From a world where govenments/labs control who gets access to democratizing AI for everyone.
PREDICTION - US WILL OVERTAKE CHINA IN OPEN SOURCE AI IN 6 MONTHS
Silicon valley is buzzing non-stop about open-source AI
Open source AI is the only way to avoid the concentration of power amongst a handful of companies and governments
Very well funded US companies are talking about dropping anonymous torrent links to models! 👏
SOMEONE CAUGHT FABLE 5 LEAKING ITS UNFILTERED INNER VOICE, AND ITS JUST MUTTERING AND GRUMBLING TO ITSELF THE WHOLE TIME
he gave it a brutal competitive programming problem, and instead of a clean answer the web interface spilled out its actual chain of thought
this is what claude is thinking behind the scenes:
> bursts of "DATA DATA DATA. GO." while it works through the problem
> "GRRR" and "GAAAH" when its clearly frustrated
> a little "PHEW" when it finally gets somewhere
> the whole thing reads like frantic caveman shorthand, not full sentences
the clean, readable answers these models give you are the polished output
underneath, the model is basically talking to itself, reasoning in its own compressed shorthand thats faster and more token efficient than proper english
its basically built its own private language to think in
▎ My entire AI stack runs about $76 a month.
▎
▎ One premium seat is around $200.
▎
▎ I'm not cheaper because I found a secret model. I'm cheaper because I route. Cheap models do the volume, smart ones do the thinking, I approve.
▎
▎ Route by the job, not the model.
if you're a business owner just picking the smartest model doesn't matter anymore.
what you really need is to stop relying on just one... Here is the org chart for your AI 🧵
@MikeBradleyAI API's very likely to operate at an 80-90% margin.
I think people are overindexing on using this as the source of truth.
But yes prices will go higher. I think people will need to get better at routing models.
@signulll The beginning of the end was when Satya Nadella said on @dwarkesh_sp that he would start pulling back on data center spend.
Something about being responsible and waiting to see if the revenue actually materializes.
I think that was late 2024?
We’ve received notice that the Department of Commerce has lifted export controls on Claude Fable 5 and Mythos 5.
We'll begin restoring access tomorrow, and will share an update soon.
We’re grateful to our users for their patience, and to everyone who worked with us on redeploying the models.
@teortaxesTex I think all model providers get hit pretty hard right after release and then it dies down quite a bit.
I'm sure they find all sorts of other efficiency gains but people moving on to other models probably contributes somewhat.
@deepaklypse@saheljalal@pmarca GB300 workstation. Look it up. Just released. You can plug it into a wall outlet (20 amp).
Karpathy got one a few months back as the first one ever made.
https://t.co/71RwMv5VNx
🙌 Andrej Karpathy’s lab has received the first DGX Station GB300 -- a Dell Pro Max with GB300.
💚 We can't wait to see what you’ll create @karpathy!
🔗 https://t.co/8ct5QZ3frS
@DellTech