🚨 ANOTHER MASTERCLASS FROM @3BLUE1BROWN
The compressibility of language isn’t just a math curiosity, it’s the hidden engine behind every LLM you use.
Grant’s new video reframes Shannon’s entropy through one elegant lens:
Prediction IS compression.
→ The better you predict the next word, the fewer bits you need to store it
→ Shannon measured English at ~1 bit per character: astonishingly compressible
→ This is exactly what GPT-style models optimize
→ Intelligence, in this framing, is compression
FUN FACT: Von Neumann told Shannon to name it “entropy” because nobody truly understands it anyway 😄
Decades later, that same concept became the bedrock of modern AI.
Deep-dive resources in the 🧵 ↓
Voyager 1 is 24 billion kilometers from Earth.
It communicates with us using a 23-watt transmitter.
Less than a refrigerator light bulb.
The signal takes 22 hours to reach us, traveling at the speed of light.
By the time it arrives, it's 20 billion times weaker than the power of a digital watch battery.
NASA's Deep Space Network picks it up using 70-meter dish antennas cooled to near absolute zero to reduce electronic noise.
The engineering required to hear a 23-watt signal from 24 billion km away is arguably more impressive than the spacecraft itself.
Launched 1977.
Still transmitting.
Still being heard.
We built something that works perfectly, 47 years later, in conditions no one has ever tested in.
That's what engineering for the long term looks like.
🎬For 300 Years ! These THREE BOOKS, were Taught across Europe to shift from Roman Numbers to Hindu Number Sys.
Presenting to you Penultimate Chapter-3 of the Movie ‘Fibonacci Speaks’ ❗️Do spread it for our Dhurandhar GenZ