growing up with you, i hope this never ends
break or fall apart
fading in and fading out
so long as we're lines growing (together) over time
tempestuous life will never cease to get to me
ah these weathers,
these seasons we're shedding like our clothes in the night, let's bare
Yann LeCun was right the entire time. And generative AI might be a dead end.
For the last three years, the entire industry has been obsessed with building bigger LLMs. Trillions of parameters. Billions in compute.
The theory was simple: if you make the model big enough, it will eventually understand how the world works.
Yann LeCun said that was stupid.
He argued that generative AI is fundamentally inefficient.
When an AI predicts the next word, or generates the next pixel, it wastes massive amounts of compute on surface-level details.
It memorizes patterns instead of learning the actual physics of reality.
He proposed a different path: JEPA (Joint-Embedding Predictive Architecture).
Instead of forcing the AI to paint the world pixel by pixel, JEPA forces it to predict abstract concepts. It predicts what happens next in a compressed "thought space."
But for years, JEPA had a fatal flaw.
It suffered from "representation collapse."
Because the AI was allowed to simplify reality, it would cheat. It would simplify everything so much that a dog, a car, and a human all looked identical.
It learned nothing.
To fix it, engineers had to use insanely complex hacks, frozen encoders, and massive compute overheads.
Until today.
Researchers just dropped a paper called "LeWorldModel" (LeWM).
They completely solved the collapse problem.
They replaced the complex engineering hacks with a single, elegant mathematical regularizer.
It forces the AI's internal "thoughts" into a perfect Gaussian distribution.
The AI can no longer cheat. It is forced to understand the physical structure of reality to make its predictions.
The results completely rewrite the economics of AI.
LeWM didn't need a massive, centralized supercomputer.
It has just 15 million parameters.
It trains on a single, standard GPU in a few hours.
Yet it plans 48x faster than massive foundation world models. It intrinsically understands physics. It instantly detects impossible events.
We spent billions trying to force massive server farms to memorize the internet.
Now, a tiny model running locally on a single graphics card is actually learning how the real world works.
turns out AI models cannot do math.. even grade school math. the kind a 10-year-old solves.
Apple published a devastating study that exposes a massive illusion at the core of artificial intelligence.
they took the standard math benchmark (GSM8K) that every AI company uses to brag about how smart their model is.
first, they just changed the names in the word problems.. the models' performance fluctuated for no reason.
then, they changed the numbers. the performance immediately dropped.
but then they ran the test that broke everything.
they added one single, completely irrelevant sentence to the word problem. something like: "By the way, 5 of the apples were green."
A human 10-year-old ignores the green apples and solves the underlying math.
the AI didn't.
across every state-of-the-art model, performance collapsed by up to 65%.
the AI blindly grabbed the irrelevant number and tried to shove it into the equation. it didn't know why it was doing the math. it just saw a number and assumed it was supposed to use it.
there is no genuine logical reasoning happening under the hood.
we are deploying these systems to run our finances, analyze our legal documents, and make complex strategic decisions.
but the models don't actually understand the logic they are spitting out.
they just know what a smart answer is supposed to look like.
something kind of potent about a majority if us grown produce being grown in an environment not where produce thrives but where the land is so rough it lacks a food chain entirely and can therefore be manufactured in a place with no natural predators
"I am now convinced that theoretical physics is actually philosophy." — Max Born
Max Born adds, "It has revolutionized fundamental concepts, e.g., about space and time (relativity), about causality (quantum theory), and about substance and matter (atomistics). It has taught us new methods of thinking (complementarity), which are applicable far beyond physics."
If I had 250 small Hamlin the Wolf stickers? I would put one in every place I go to, then in those places relevant events will happen, soon they'll realize it's the influence of Hamlin. That's the start of a new religion.
Sorry for my far left opinion, but every job should pay a living wage that allows people to actually live. If someone works at KFC, they should be able to pay their bills, meet their basic needs, and still save money, because that is what work is for.
The benefits are enormous: by stabilizing the supply chain and lowering equipment costs, our research shows that California ratepayers could save up to $200 billion cumulatively over the next 25 years and develop thousands of direct union manufacturing jobs.
The California Grid Manufacturing Initiative would facilitate statewide planning for grid needs and leverage bulk procurement to bring down prices. If needed, it could also incentivize or enter joint venture agreements with CA manufacturers to meet needs.
Zohran Mamdani’s proposal to speed up buses and make them fare-free provoked excitement and debate during his mayoral campaign. But NYC isn't the only place where there's political momentum for better buses: municipalities across the US have been eliminating fares for all riders and making strategic improvements to speed up bus service.
@themarginalian To be complete you could add that Schumacher’s work has an inspiring follow up by Thai social activist Sulak Siravaksa. He wrote this little gem:
https://t.co/FLmDxSFCfG
Buddhist Economics – from half a century ago, a wonderful vision for prioritizing people over products and creativity over consumption https://t.co/ho13JKBLnn
@Math_files I do not quite agree. Mathematics is about structure, imo.
The understanding is key to our experience of it, but it isn't strictly part of the mathematical content.
#JNeurosci: This study from Gerin and Andres provides straightforward evidence that we use information about the body in canonical postures to localize tactile stimuli on body parts.
https://t.co/kBBY9Tpu54
@LensScientific Scientists are the ones who chase brand-new ideas like they’re chasing lightning in a bottle. Engineers? They take what’s already known and turn it into something that actually works in the real world clean, stable, and dependable.
Finite Element Methods use fine meshes only where greater detail is needed, allowing the focusing behavior of a convex lens to be simulated accurately without the cost of refining the entire domain.
Complacency is a killer holllly shittttt lock tf in and achive something noteworthy to yourself. This is garbage advice. Be someone be something stand by or for someone.