@ylecun@dr_qfe I guess this is because people confuse two kinds of "=" signs. One belongs to math and theorems, like √(x^2) = x (just true) , the other one belongs to theories, like F=m*a (true until some data proof that it is not)
In March 2021 I contemplated leaving @OpenAI to start a company around the ideas that open source and open research were going to win. I decided it was too early but obviously that's no longer the case. Here was my thinking at the time. Who is building this? I Want to help them.
This is another piece that basically says "deep learning is not as impressive as you think because it's mere interpolation resulting from glorified curve fitting".
But in high dimension, there is no such thing as interpolation.
In high dimension, everything is extrapolation.