These are not separate problems.
A recursively improving system eventually attacks every assumption around it:
its metric,
its generalization bound,
its model of the world,
its own implementation.
RSI is what remains valid after the learner becomes part of the theorem.
Accepted across #COLM and multiple #NeurIPS workshops
Our research program: infrastructure for recursive self-improvement.
Measurement that survives optimization.
Generalization that survives self-rewrite. Counterfactuals under intervention.
Formal learning theory that actually compiles.
@ayushmi5@Zetetic_Dhruv
Formal Learning Theory in Lean 4 - AutoMLR oral spotlight
Before rebuilding learning theory for systems that recursively modify themselves, we wanted the old foundations machine-checked.
So we formalized the Fundamental Theorem of Statistical Learning - five ways.
Paper + code coming soon.
Recursive self-improvement is not an optimization problem until it first becomes a measurement problem.
An optimizer that understands its metric is already part of the measurement apparatus.
We’ll be presenting where that can be made precise at the Lifelong Agents workshop at #COLM2026
The larger question for us:
How do you build a machine that can rewrite itself while preserving a notion of "better" that it cannot rewrite with it?
That feels very close to the real starting point of #RSI.
@ylecun@Dan_Jeffries1 Pro-intelligence. But intelligence without the ability to understand consequences is just increasingly powerful prediction.
The real question is whether we can make intelligence that understands the world well enough to know what its actions will cause.