@DimitrisPapail As an experiment, I've banned words and phrases like "load bearing", "smoke test", "wire in", "landed", "shape", and "guardrails" in favor of specific, clear, and plain alternatives. I think I see the LLMs generating better code and technical work as a result. Dunno.
@JunoRavin@lanyon_ai@getjonwithit@minmodammar Thanks! I was looking at that benchmarking post. More details about that C evaluation would be great. Same with that IEEE-754 work. The symbolic work on the DSL is cool.
I'm not really seeing the end-to-end proofs of correctness through to C. (I do love the Racket DSL!) If the C analysis is based on sampling, how is the sampling performed? How are the criteria established? I guess the double vs Real trouble is hard to avoid. 1e-8 and all that. C semantics itself I guess is way out of scope.
I want verifiable extraction to a back end that itself is verifiable -- or at least somewhat so. That's why I was trying WASM with https://t.co/elwdytwtYB. My compiler is in Lean of course. It's hard to prove that the generated WASM is correct, but it is sometimes feasible. Here's an (undocumented, sorry) proof that some WASM really does correctly implement a central limit order book for limit orders. https://t.co/9Y7bLrGpop
Leo has updated the Lean kernel to fix this bug though it appears Comparator itself is still vulnerable to this. As always, more thorough discussion can be found on the zulip: https://t.co/hiAwRIndjC
I would add just one more stage to this: we need to verify that the Lean *statements* and *definitions* actually say what the natural language proof says. This “semantic alignment” problem is not solvable in silico! I’ll mention this in my talk on Monday night. #ICM2026