New on our Frontier Red Team blog: using Claude to formally verify software at large scale.
Formal verification can prove that code is free of certain bugs, but historically it has only been feasible for small codebases (or required a lot of expert time).
With AI models, however, this is beginning to change. In collaboration with @theoremlabs, we used Claude to prove security properties in over one hundred real-world open-source libraries over the span of a few weeks.
Read our research in full here: https://t.co/zUyx8CjBEk
I cannot agree more. Kevin Buzzard made so many points I agree with. But the best one is this
"I thus believe that in the future we will reach a new “natural boundary” in mathematics, beyond (and perhaps way beyond) where we are now, but where machines are going to get stuck and where it is not viable to expend any more resources to make the next big leap. (...) I believe that the optimal thing to do (...) is to let the machines loose, see what happens, and then begin the journey to where they have stopped."
https://t.co/6J55GjyaST
Moving from individual proofs to large-scale autoformalization requires new tools. We introduce Choir, an open protocol for multi-agent autoformalization that decomposes projects into tasks, coordinates contributions through GitHub, and deterministically checks them before merging.
Choir is modular, open source, and supports Lean 4, Isabelle, and Rocq.
Repository: https://t.co/gKMH4gFXTn
Preprint: https://t.co/vRFqCJDyno
Led by @yidi_qi. Supported by @darpa expMath.