sui generis. “There are more things in heaven and earth, Horatio, than are dreamt of in your philosophy.” Engineer, father of two, maker, thinker, tinkerer.
A man from Persia mastered Arabic so well that every time he spoke to Arabs, they'd ask him:
"Which Arab tribe are you from?"
He'd laugh and say: "I'm Persian. But I speak Arabic better than you do."
Until one day a little girl destroyed him with one sentence.
SpaceX has almost finished writing V1.0 of an in-house AI training stack in C that exact-maps to 220k GB300s with 800G NICs, making heavy use of pipeline parallelism and getting as close to bare metal as possible.
The potential speed improvement vs JAX for large training runs is over an order of magnitude.
@Orso_I_Tink@elonmusk Python users: order takeout or use restaurants.
Budget=$2,000 a month.
C users: cook at home but buy food from grocery stores.
Budget=$200 a month.
Assembly language users: cook and grow their own food.
Budget=$200 but it can go down to $20 in some cases.
Researchers proved that every single elementary function, sin, exp, log, sqrt, comes from one single binary operator.
It is like finding the “God Particle" for calculus.
In computer science, every complex program breaks down to a single logical operator: the NAND gate. It is the fundamental building block of all digital reality.
But for continuous math, physics, engineering, machine learning, we thought we needed a massive toolbox.
Addition. Subtraction. Trigonometry. Logarithms.
Every scientific calculator and neural network has to juggle all of them.
Until today.
But this paper proved that every single mathematical function can be generated by a single, bizarre binary operator.
eml(x,y) = exp(x) - ln(y).
Combine that with the number 1, and you can build everything.
Pi. The square root. Sine and Cosine. Arithmetic.
It is all just the exact same operator, repeating over and over again in a binary tree.
Nobody anticipated this existed. It was found by systematic exhaustive search.
But the implications for AI are massive.
Instead of an AI struggling to combine different mathematical rules to discover a new scientific law, it can just use a single, uniform architecture.
One trainable circuit. One repeatable node.
We thought the language of the universe was complex.
It turns out, it's just one equation repeating in the dark.
@ea4eoz@sudox7 The instruction generated depends on the data type of x, signed or unsigned. If the type is signed, the C compiler will use the correct instruction.
These two giant turtles have been fighting each other for more than 120 years.
According to the zoo, one turtle stole the other’s food 120 years ago, and since that day they became enemies.
There hasn’t been a single day where they don’t fight for 2–3 minutes😂
“Give them a massive amount of oil, agricultural land, copper, freshwater, and every natural resource in the world. Now make them neighbors with the biggest market in the world. Great, now have them leave the resources in the ground and instead flip condos to each other”.
@ronmortgageguy Oh ye of little faith!
Don’t build cars the way they have been built for 100 years. Make them like PCs with interchangeable components and an ecosystem of suppliers.
Canada is big enough for that.
@VladTheInflator lol. How Does the slope of the bottom graph go negative? Is she reverse aging? Lol.
It should be discontinuous but always rising with a slope of 1yr/yr.