I’ve written code professionally since 1994. I’ve been a team lead. I’ve been a development director. I’ve been a CTO. I like to help. No question about software is too basic or too complex. I just want to share what I know.
@tottinge ML applications are a different kind of software. Modern ML is truly a scientific breakthrough. You can create things with ML that weren’t possible before. The business value problem is about non knowing how to turn this tech into products.
@ylecun@ESYudkowsky@braneloop 10 years is still very soon for such a world changing technology! PS I appreciate FAIR publishing your work and releasing open source models.
Physicists think AI is physics.
Statisticians think AI is statistics.
Mathematicians think AI is mathematics.
Psychologists think AI is psychology.
Neuroscientists think AI is neuroscience.
And they’re all right.
@skdh If you feed an ML system observations about Nature, it can find patterns in the data. This is what physicists do. But, physicists are limited by the architecture of their brains. Is it physics if you invent better physicists?
@Grady_Booch Sure. But the thing is that we’ve learned so much about learning and reasoning in general from making LLMs that the next steps will be way easier.
@LeoIsTallish @etaaffe@Grady_Booch@kimmonismus I don’t think it will be mutually exclusive, I think it will compound. For example maybe language models will be the long term memory for a different kind of reasoning model. Maybe we are just using them to do too much. Billion dollar companies are grinding on reasoning.
@LeoIsTallish @etaaffe@Grady_Booch@kimmonismus I’m more in the Yann LeCun camp that we need a couple more breakthrough, not just incremental improvement to LLMs. I think we will find that the border between memory and reasoning is fuzzy and that LLMs are more like long term memory than generic reasoners.
@LeoIsTallish @etaaffe@Grady_Booch@kimmonismus It’s not magic because your mind is a natural object. You just have to imagine a system that can do all kinds of reasoning, not just about code. A market hypothesis’s is reasoning. A theory about what causes a bug is reasoning.