Amrut

AI evaluation

[Amrut @amrutavhad]

Not hidden, it is in their own documentation. But it means the numbers being compared were not produced under the same conditions.

[Amrut @amrutavhad]

The gap between the best AI models is now a few points. The gap in how those points are measured is much bigger than that.

[Amrut @amrutavhad]

When two models are two points apart, do you trust the difference, or the ruler?

[Amrut @amrutavhad]

WE WANT RESETS @AnthropicAI @ClaudeDevs

[Amrut @amrutavhad]

@WiFiMoneyGuy amen

[Amrut @amrutavhad]

@bdono_ @Stanford @ToyotaResearch Really interesting :)

[Amrut @amrutavhad]

@Im_IrushiK Fable 5 is just SO good and it knows too much about me now..

[Moonfarm 🇸🇪 @moonfarm_dev]

COME ON, I HAVE LIKE 10 MINUTES LEFT BEFORE I NEED TO GO TO BED 😭

[Peter Steinberger 🦞 @steipete]

lol did nobody at Anthropic stop for a second and wonder why the numbers looked this absurd before posting the “victory”-tweet?
https://t.co/DPdPc04YZT

[Amrut @amrutavhad]

@ClaudeDevs

[Khalid Nouri @uxnouri]

We deserve a Claude limits reset

[Amrut @amrutavhad]

@uxnouri WE WANT RESTSSSS

[Amrut @amrutavhad]

@argofowl @ClaudeDevs WE WANT RESETS

[🥔🥔🥔 @argofowl]

hey @ClaudeDevs, how about a usage limit reset?

you had a pretty major outage that disrupted everyone’s exquisite flow

do the right thing 🙂