So excited to introduce Leanstral 1.5, an open source @leanprover code agent model which is SoTA on FATE-H/X, 587 on PutnamBench, and solves all of MiniF2F with only 6B active parameters! It is free to use, so give it a try!
https://t.co/mWNOMLuWtN
Leanstral 1.5 is here. SoTA on FATE-H/X, 587 on PutnamBench, saturating miniF2F, all with an Apache-2 6B active params model. We are having fun verifying code properties and catching bugs in Rust repos!
Tech report covering training environment and evaluations: https://t.co/4zVUZfArn3
We also open-source LeanstralSafeVerify and FLTEval.
@octonion Here is a list of at least some of them, but I’d love to find a more comprehensive list of these super broad conjectures: https://t.co/A5jYHkZ5sd
@MoritzFirsching@Almost_Sure If you do, also add the hyperbolicity conjecture for the Mandelbrot set and that the boundary has zero area. Those two combined would resolve my conjecture positively.
@ChrSzegedy@ColmezPierre Yes, LANA didn’t get very far with the formalization (and was overly PC). A full completion of the LANA formalization with just a small remaining gap left for Mochizuki to fill in would be interesting and hopefully valuable to the anabelian geometry community.
@tonylfeng@aaswaminathan01 How challenging is it to *state* the GLC in current Lean. Maybe GLC should be added as a challenge to LeanEval. Then @IlinVasily29521 will be compelled to fill in the proof.
@deancureton@schweingehtbree@geoffreyirving It would even better if this proof was in Tau Ceti (alongside the CFSG statement). It would act as a good unit test on the statement which is robust to library refactors.
@ShriramKMurthi@PommeTomateRiz@rs_datascience I don’t mean “check” in the sense of 100% confidence, but I mean greatly improve the confidence that the spec is right and useful toward the goal. Humans can review other’s specs so why can’t machines? You can even use proofs to improve trust in the spec. I’ll DM you tomorrow.
@PommeTomateRiz@rs_datascience@ShriramKMurthi Ok, I was confused because you responded to my post responding to the claim that Lean can prove false. (And because when people talk about “verifying the verifiers”, they often are taking about proving false as well.) Anyway, thanks for clearing that up.