@TheDavidTai Woah, didn't realize prefill on the new Macs can be this high 🤯 It seems to make them VERY usable for 4.1 1017, even with 256 GB RAM right?
security AI is not doing those things all by itself though. It's given deterministic tools built by humans with decades of experience. Then AI just automates running them, like in the RE-anything project.
For the math result, Levent himself admitted it's "slop" that he didn't read himself yet. Yes it's given Lean verifier but as always with these results, they need to be independently verified. It's also unclear to what extent Anthropic might have again stolen research of the other researcher who has worked on this problem for the past several years. Plus again, this is not intelligence when results can be mechanistically verified - they are essentially brute-forcing the problem by throwing compute on it, and combinatorially arrives at result thanks to those deterministic tools (like Lean) written to humans. If you give a typewriter to a thousand monkeys, they may indeed arrive at some smart solution but each individual monkey is not that smart..
Just saying that we're giving these clunkers a little too much credit. The areas they excel at that you mentioned - it's all based on deterministic tools that humans have built. AI in its current state would not be able do it all by itself without relying on them, unlike humans.