@authoramish I'm not a historian, but I feel there's a flaw in the argument. I'm sure civilizations who were not associated with yoga still had the freedom/ability to participate in different physical poses. And I think the indus valley civilization is supposedly much older than patanjali
Terence Tao put it plainly: there is no evidence that LLMs exhibit genuine creativity.
Yes, they have solved some Erdős problems. But these are low-hanging fruit, questions that attracted little attention and that yield once the right existing techniques are applied. That is not creativity. That is search plus recombination.
Yes, LLM outputs can look impressive. But look at who is impressed: typically non-experts. Experts know very well that LLM performance gets terrible when you approach the frontier of human knowledge.
And this is not a temporary gap. It reflects a structural limitation.
We do not fully understand human creativity. But we do know a key property:
Conceptual leaps: the ability to generate new representations, not just recombine existing ones.
LLMs do not do this. They interpolate in representation space. They operate within existing conceptual frameworks; they do not create new ones.
This is why we haven’t “yet seen them take the next step”.
@kansaratva It is very much a fact and real news. Many items have been stopped in our hostel mess, at IITB. I got to know that the same is happening in other IITs too. I don't find it correct for people to attack journalists who are just doing their job.
“Science cannot solve the ultimate mystery of nature. And that is because, in the last analysis, we ourselves are part of nature and therefore part of the mystery that we are trying to solve."
— Max Planck
@sama To say NNs learn, I feel, maybe an overstatement. They are just highly complex functions which fit the data well given appropriate number of parameters.
The phenomena of learning is still a mystery I feel, way beyond the scope of NNs
“That's here. That's home. That's us. On it everyone you love, everyone you know, everyone you ever heard of, every human being who ever was, lived out their lives.” –Carl Sagan
Earth from the perspective of robotic explorers: https://t.co/TTB9xsFbQt #NASA4Earth#EarthDay