geoffrey hinton won the nobel prize in physics for building systems he couldn't fully explain - this october 2026 paper explains them, and the number that stopped me cold was 3,418 gradient steps to reach coherent reasoning from a random start state
"the most incomprehensible thing about the universe is that it is comprehensible" - einstein said that in 1936. he was describing physics. this paper proves he was also describing GPT-4, claude, and every LLM generating $3.8T in value right now, without anyone understanding why they actually work
every token your LLM generates costs energy. literally. p(τ) = (1/Z) exp(-E(τ)) - the probability of any reasoning trajectory follows the same Boltzmann distribution that governs how atoms arrange themselves in a crystal. your $0.002 per 1,000 tokens API call is a thermodynamic event.
the energy landscape visualization shows the full picture. high-energy region = inconsistent hallucinating output. saddle point = transition between concepts. low-energy basin = coherent reasoning. the model doesn't compute - it falls downhill through 10,000+ dimensions toward the most stable physical state.
neural dynamics: dh(t)/dt = -∇E(h(t)) + ξ(t). gradient pulls toward lower energy. noise term ξ(t) enables exploration before convergence. this is exactly how particles find equilibrium in statistical mechanics. hinton's backpropagation was gradient descent. this paper proves the entire LLM reasoning process is gradient descent - not just the training.
phase transitions explain why GPT-3 to GPT-4 felt like a different product entirely. small models stay trapped in high-energy fragmented states. large models cross a critical threshold and exhibit stable low-energy attractors. the capability jump wasn't more data. it was a phase transition - like water suddenly becoming ice at exactly 0 degrees.
the companies that engineer phase transitions deliberately instead of scaling blindly will compress 3 years of R&D into one architecture decision. that knowledge is sitting in a physics framework that 99% of AI teams have never opened.
hinton understood the gradient. this paper maps the entire landscape he was descending into.
Bookmark & watch today.
Every token your model generates is a system falling toward equilibrium.
You are looking at a photo of Einstein’s actual notebook.
The Zurich Notebook (1912) is Albert Einstein’s actual handwritten journal, preserved and studied today, capturing the pivotal early phase of his development of General Relativity.
While back in Zurich and collaborating with mathematician Marcel Grossmann, Einstein filled this 96-page notebook with dense calculations and ideas as he struggled to reconcile gravity with his earlier special relativity.
It shows the messy, iterative process behind one of the greatest scientific breakthroughs: Einstein began to abandon the traditional view of gravity as a force and instead explored the revolutionary concept that gravity is the curvature of space and time itself, using the then-novel mathematics of Riemannian geometry.
Although he had not yet fully mastered the required tools and the final equations would only be completed in 1915, the notebook reveals the raw, trial-and-error thinking—full of false starts and bold questions—that eventually led to the theory explaining black holes, gravitational waves, the expansion of the universe, and much of modern cosmology.
This unpolished record humanizes genius, reminding us that even the most profound scientific insights emerge from persistent effort, mistakes, and ordinary tools like a pencil and paper.
[University of Pittsburgh. (2012). A peek into Einstein's Zurich notebook. University of Pittsburgh]
Mathematician Terence Tao:
"we're seeing the end of the romantic era of mathematics, the age of heroes. we're moving into an industrial era where math becomes large-scale, done in big teams like the other sciences"
We're entering, rather unwillingly, a new era where exciting new things are possible, but some things are being lost
Researchers in @ScienceAdvances have demonstrated that brief physical contact between healthy and bleached coral can restore algae to the bleached coral, leading to their full recovery. https://t.co/xennKZbdW0