@Thackej@calebwatney I guess I was specifically thinking about the case of looking at an order book. Beyond basic heuristics, no human could look at an order book and make predictions on futures prices, though quasi-LLMs can do this quite succesfully.
@JoePostingg You could also imagine a world where the “best” generals are just the luckiest.
I.e., they are perceived to be great because they were lucky.
@alexolegimas I’ve never tried the 99 cent pizza, but it’s on my bucket list (though I have low expectations). I haven’t been impressed with the $1.50 slices so far, though perhaps I’m a bit of a pizza snob.
@YudaB11@joaogsantosc@AnthropicAI At first I thought there was a chance that I would get one too, but he got an email, which I haven’t received, so it looks unlikely.
@alliekmiller In one of the commit messages, it claimed to be:
Co-Authored-By: Claude Fable 5 <[email protected]>"
even though the model was clearly set to Opus 4.8.
@Eldergenix I've been checking for the past week, and every time I check, it always says the site has been updated in the last <2 hours, so I don't think these are actual updates.
@Rolando_Rojas1@synthwavedd@OpenAI This is basically the same thing, where the newer generation of the smaller model, Flash 3.5, is better than the older, bigger model, Pro 3.1.
@Rolando_Rojas1@synthwavedd@OpenAI Sonnet was better than Opus when Sonnet 3.5 was out, and the most recent Opus model was Opus 3, and then when we had Sonnet 4.5 vs. Opus 4.1, but at the same level (i.e., 5 vs. 5), Opus and Fable should be better than Sonnet.
@Rolando_Rojas1@synthwavedd@OpenAI I think they have 4 classes of models, Haiku, Sonnet, Opus, and now, Fable (Mythos and Fable are essentially the same, except that Fable defaults to Opus on some sensitive queries).
@xeophon Why does the score need to be revised down? If anything, on those 8% of samples, you would expect Fable 5 to do better than Opus 4.8, raising the overall score.
@dlwiest There’s better security with the enterprise plans.
I also think they’ve largely stopped selling the fixed monthly fixed price plans to enterprise, so to get the good Claude Code deals, it would have to be a personal account.