I created a thing that analyzes scientific reasoning produced by llms. Current statistics on HLE-Verified Gold text only: 99%* accuracy @57% coverage, n=184.
https://t.co/OdJPqGI1cb
*counts cases where Theoria's answer disagreed with the key but appears to have caught key errors as "correct." Strict floor is 88%. Feel free to try yourself. Requires both claude cli and codex cli.
Imagine having a monster season in your fantasy football league, going 12-2 and then your starting QB suffers a concussion in the 1st quarter of your semi-finals matchup.
Such a cruel game it is.