@industriaalist Thank you! It's a work in progress and I'm about to improve the approach.
That said, any feedback is welcome, be it on clarity, methodology, or missing related work.
@SarahTheHaider I am not saying you should listen to Scott Alexander, but I don't see a reason why anyone should listen to someone that declares in 2019 that deep learning has peaked, doesn't acknowledge that they are wrong, and now limits who can respond to their tweets.
@GaryMarcus@IonelChiosa@altryne Then there is no reason to claim that millions of potential solutions were considered until one of them had a Lean formalisation. Looking at the chain of thought traces, most likely that the informal proof was obtained first, then formalised in Lean.
@IonelChiosa@GaryMarcus@altryne Most likely the proofs were formalised in Lean once the agents discovered informal versions. Either way, there is no evidence for Gary to claim that millions of proofs were tried until one was proven correct in Lean.
@pmddomingos What makes you think they don't suffice for automating the process of discovering models that have these properties? Or at least make it massively faster compared to human researchers discovering them by themselves?
@slatestarcodex@pmddomingos And LLMs might be enough to discover models that have these properties at inference time, i.e. automate the research process.
I just wrote a great piece for WIRED predicting that the AI bubble will in collapse in 2025, and now I wish I hadn’t.
Clearly, I got the year wrong. It’s going to be days or weeks from now, not months.