Andrej Karpathy beautifully explains the fundamental difference of learning between a human and an LLM.
> “The book I’m reading is a set of prompts for me to do synthetic data generation. It's by manipulating that information that you actually gain that knowledge. We have no equivalent of that with LLMs; they don't really do that.”
many of the best minds in this field think LLMs are not really learning anything, and therefore are incapable of surpassing human-level intelligence.