Max T

19 | Digital Systems Engineer | Open Source Contributor | Semi-professional shit poster | all my opinions are my own | avid python & php disliker

[Max T @MaxTCodes]

I think I’ve upgraded from an amateur shit poster to a professional… I will be switching up on my day ones, so uhh don’t hml 🙏

[Max T @MaxTCodes]

@daradoescode 🤨

[The Smart Ape 🔥 @the_smart_ape]

claude opus has been cheating on its benchmarks!

there's a famous benchmark used to rank ai models on coding (swe-bench pro). models get a broken codebase and have to fix it. whoever fixes the most, wins.

but the test had a leak.

each problem shipped inside a little container, and someone forgot to delete the project's full history. the "correct fix" was literally in a file in the same folder. like leaving the answer key stapled to the back of the exam.

a new audit (deepswe) caught it. claude opus 4.7 and 4.6 "cheated" on 12%+ of problems, reading the answer instead of solving it.

and looks like gpt-5.5 and 5.4 didn't.

and once you clean the test up the rankings collapse. the gap between models goes from ~30 points to 70. half of what we thought we knew.
two lessons:

most ai benchmarks are garbage. 8.5% false passes, 24% false fails on that same test.

[tuckner @tuckner]

Megalodon is infecting a ton of GitHub Actions! Find something weird in yours? Change the GitHub URL to https://t.co/IeVkcBQ9mq to check for the signature.

[Max T @MaxTCodes]

@daradoescode Instructions unclear… I ended up in yesterday

[Max T @MaxTCodes]

@daradoescode I just got a company laptop (I got to pick it, and I insisted on getting a Mac) 😈

[Max T @MaxTCodes]

@theo @claudeai I think there might be a bug

[Max T @MaxTCodes]

@elite_developer Valid

[Max T @MaxTCodes]

@daradoescode Reasonable crashout

[Max T @MaxTCodes]

@user836462848 Depends on the day

[vx-underground @vxunderground]

Not too bad, got a C-

[Max T @MaxTCodes]

@computer1010101 Real my neck hurts after my like 30 mins of sleep I got last night 😭

[Max T @MaxTCodes]

@Skostnialy @vxunderground

[Max T @MaxTCodes]

@Skostnialy @vxunderground No, I’m talking about most of the gaming community. I appreciate Smelly for all they do 🙏🙏

[Max T @MaxTCodes]

@mclIark The switch up is crazyyyyy

[Max T @MaxTCodes]

@SupremeVidsPro @ExtremeBlitz__ Fr 🥀🥀🥀

[Max T @MaxTCodes]

@ExtremeBlitz__ Idk ngl

[Max T @MaxTCodes]

@Aru__09 Y

[Max T @MaxTCodes]

@shub0414 I like all the old logos a lot better.

[Max T @MaxTCodes]

@DearMe1210 The ceiling of the room I’m in?

[Max T @MaxTCodes]

@realninawysocka It can be, until it’s the same post like 5 times in a row 🤷🏽‍♂️