Even though many labs have stopped publishing, itโs great to see frontier research is alive and well. This one ๐๐ผ from @hardmaru at @SakanaAILabs
For over a decade, weโve accepted that end-to-end backprop is the only way to train deep networks. But holding the entire network in memory all at once is why AI training is hitting a resource wall.
We found a new way to break the network into blocks and train them independently. The trick? Treating the networkโs forward pass like a diffusion model denoising a signal.
This reinterpretation slashes the memory needed to train deep models. In our #ICLR2026 paper (https://t.co/PK5h0mqQSo), we matched end-to-end performance across ViTs, DiTs, and LLMs. We did this while training just one isolated block at a time.
By definition, only a few investors have a power law company in their portfolio. But even fewer venture funds consistently invest in them at the earliest stages. Nice to see @500GlobalVC continue to be one of the top VCs on the power law list.
Venture returns follow a power law. Only a handful of investors bend the curve.
Just 1.5% of VC-backed startups ever reach $100M in revenue. 89% of investors have never backed one.
A small number of VCs back power law outcomes again and again. The 8th annual Power Law Investor Ranking names them โ the top 50 global power law VCs ๐
โThe first gulp from the glass of natural sciences will turn you into an atheist, but at the bottom of the glass God is waiting for youโ
-Werner Heisenberg
1932 Nobel Prize in Physics for the creation of quantum mechanics
@jiahanjimliu@xiaochuan8688 You canโt just compare yield rates as they are often not apples to apples. Yield on process nodes will be higher than the advanced nodes, so you can pull numbers that show just the opposite if you wanted, depends on what you are picking.
@jiahanjimliu@xiaochuan8688 You canโt just compare yield rates as they are often not apples to apples. Yield on process nodes will be higher than the advanced nodes, so you can pull numbers that show just the opposite if you wanted, depends on what you are picking.
Has anyone noticed how expensive ice cream has become? At $10 per pint, thatโs more expensive than copper and comes close to some strategic battery materials like lithium.