JimGale

Currently in Microsoft:Edge, using ML, AI & NLP. Creator of @CrossCodex, and a few others.

[JimGale @jimgale]

Caveat: one user, one week, n=1. The residual gap never fully closed.

But the cheap model now asks "what's the cheapest test that could kill this claim — and has it run?" before telling me something works.

That question was most of what I was paying for.

[JimGale @jimgale]

In the recent week with Claude Fable 5, instead of just using it, I had it run side-by-side comparisons vs Opus on all my real work — same task to both, then a decision-level diff.

Goal: capture its JUDGMENT, not its answers, in a form Opus can load.

What I learned 🧵

[JimGale @jimgale]

How to copy this:
• Distill the diffs into a ~900-word skill file — only rules that changed decisions
• Never let a model describe itself (flattering fiction)
• Demote rules that stop differentiating
• Keep score both ways — its falsified hypotheses are in my record too

[JimGale @jimgale]

@claudeai omg. down-to-earth relatable genius model. ty

[JimGale @jimgale]

@zacbowden Asking the past what the future is? Doesn't always get you the right answer.

[JimGale @jimgale]

Tron:Ares
The struggle between bad prompting and good training data

[Microsoft Copilot @Copilot]

Well, train my model and call me Sally — Apple recognized my new features and experience for App of the Day 🎉 https://t.co/8HlRl5DWHP

[JimGale @jimgale]

@mreflow - your mission, should you decide to accept it, is to compare OpenAI and Google I/O's AI in an objective way. I/O seemed better than I expected/the past, but not as good as OpenAI, but, in a few ways unique where OpenAI can't. But I'm probably biased. Looking fwd to it.

[JimGale @jimgale]

@waDNR Remember not to look directly at the sun. You might get rain in your eyes.

[JimGale @jimgale]

@GitKraken 12 hours later... 'please?'... it's not expired.

[JimGale @jimgale]

@GitKraken not for the last few hours almost a week later

[JimGale @jimgale]

@GitKraken Failing again now - even after logging in. Servers down again? weekends?

[JimGale @jimgale]

@GitKraken also, please communicate how to deal with it. 1 of my 4 machines still has this. Restarting didn't help.

[JimGale @jimgale]

@GitKraken Feels like you only figured out users were having problems way after it started. Please inform users that you are working on a solution early on (assuming you were).

[JimGale @jimgale]

Yep, replied to email per caller recommendation. another email saying, no, you need to call, and another agent will help. All this to replace a "known motherboard issue" with Pixel 5a5g, paying a replacement cost, while paying and under warranty.

[JimGale @jimgale]

Hey @Google, your phone support staff really want to help, but keep giving uncoordinated or bad information. i.e. after authorizing overnight, then failed, asking customers to call @FedEx to make it faster isn't allowed. Also email saying call, then calling says email? #ucandobtr