Columbia CS Prof explains why LLMs can’t generate new scientific ideas.
Bcz LLMs learn a structured “map”, Bayesian manifold, of known data and work well within it, but fail outside it.
But true discovery means creating new maps, which LLMs cannot do.