If deployed widely - I bet this will save the US healthcare system at least 100x all of MJ’s profit to date.
It’s a great example of how much better someone like David is able to allocate capital than ~the rest of the world.
The AI boom should empower a generation of people who understand just how fast we can climb the tech tree, and will dream very, very big. Expect incredible things.
When Midjourney Dyson Spheres?
It's very cool that Apple shipped a 20B parameter on-device.
You can't put 20B parameters in RAM at any reasonable precision. To make it work they are using pretty exotic architecture by today's standards.
A small model predicts from the query (or prompt) which experts to load from Nand into RAM. The key distinction from a typical MoE is that you do this once per query and then generate all the tokens with the same experts (instead of switching the experts for every token).
The events of the last 6 months in technology are arguable amongst the most important in human history
The tools now increasingly exist for recursive self improvement of models & agents
We are likely in very early lift off & exponential
Largely unnoticed outside of tech
Introducing Project Glasswing: an urgent initiative to help secure the world’s most critical software.
It’s powered by our newest frontier model, Claude Mythos Preview, which can find software vulnerabilities better than all but the most skilled humans.
https://t.co/NQ7IfEtYk7
We’ve trained a multimodal AI model to turn routine pathology slides into spatial proteomics, with the potential to reduce time and cost while expanding access to cancer care.
The AI supply chain has the craziest value cascade of any industry in the world.
thinks that over the next five years, the biggest bottleneck to deploying AI will be EUV machines.
ASML sells EUV machines for $300-400 million. You need about three and a half machines, so $1.2 billion, to produce a gigawatt of compute each year.
So $1.2 billion of ASL and ML machines are producing $35 billion worth of NVIDIA chips a year (and of course those machines can be used over many years).
Then those Nvidia chips can generate $100s of billion of token revenue for AI labs.
Or think about: over the last three years, TSMC spent $100 billion on CapEx.
A small fraction of that went to building the fab capacity used for Nvidia's chips. Nvidia turned that fraction into $216 billion of revenue last fiscal year alone. Relative to the value of the thing they’re producing, TSMC’s CapEx looks crazy small.
So why aren’t ASML/TSMC/etc juicing up margins to capture more of the value they’re generating? And why aren’t they scaling up CapEx so that they can take advantage of the crazy AI growth worlds?
@dylan522p says that it’s because these upstream players aren’t AGI-pilled enough. They’re still looking for stable, gentle long-term growth. The insane demand signal is taking a long time to percolate up the supply chain.
Congrats to @maxhodak_ and the @ScienceCorp_ team on their $230M Series C!
Their PRIMA implant is letting blind people see again: improved vision in 26 of 32 trial patients with advanced macular degeneration. They're on track to be the first BCI company to bring a vision restoration product to market.
https://t.co/mX0cdpt5LV