Aditya Varma

"I learn then I earn"

[Aditya Varma @ddavarma_]

A separate agent, from the spec, never from the repair. In this build Claude Code wrote the hold-outs for each target (benchmarks/targets.json) using only the v2 OpenAPI document or the SDK migration guide; Muse Code did the repair and never saw them. Each set was validated both ways before use: all fail on the old code, all pass on a hand-written reference migration that isn't committed.
Letting the repair agent write them is the failure you describe: its misreading of the spec lands in both the code and the referee, and you get a confident green. Separating writer from repairer, and anchoring the writer to the spec rather than the code, is the whole point. If a hold-out is still wrong, the run stalls after three tries and a human reads the log; nothing ships.
So it doesn't scale past "something that has read the contract writes six to eight assertions." I think that's the right trade: a spec-derived test is cheap and the one artifact in the loop that didn't come from the model being checked.

[Aditya Varma @ddavarma_]

I built DriftZero this week for the Meta Global AI Developer Hackathon.

It migrates your code across a breaking API change, then proves the migration with tests the agent never saw, in a clean sandbox, before opening the PR. The agent does the work. It never grades it.

Ran it on two public repos I'd never seen. Both verified, under a dollar each.

Muse Code for the repair, Muse Spark 1.3 for the spec diff, Muse Spark Open (open weights, on @basetenco) as the reviewer, @modal_labs sandboxes for verification.

Demo: https://t.co/XV5fz6y8tg
Repo: https://t.co/7OBPemaSkr

@AIatMeta @cerebral_valley #MetaHackathon #AIAgents #DevTools #MetaGlobalAIDeveloperHackathon

[Aditya Varma @ddavarma_]

Both, and the misses are in the repo.
Caught: the health-range bug on the demo run (agent 25/25, hold-out 7/8), and on the first external repo the hold-outs refused to even collect, which is how we found the agent had stubbed out the SDK behind try/except ImportError so its own tests would import without it.
Missed: the agent rounding derived values to 1e-3 so an unchanged exact-equality test still passed. Hold-outs use tolerances, so they didn't object. A static guard can't see it either. That's why there's a second model reviewing the diff with the unchanged tests in context; it catches that one about 5 times in 6. Catch rates are in docs/reviewer_eval.md.
The rule that fell out of it is the hold-outs test the contract, not the agent's cleverness. For your decode-and-play check, the equivalent is a few assertions written from the spec of "ready" that the model never sees, run on a box the model never touched.

[Aditya Varma @ddavarma_]

@agnes_bi_do Agreed and i added MIT now every run log and the reviewer eval committed https://t.co/Kq8QmLWW2C. The hold-outs for the three targets are in benchmarks so you can rerun the exact migrations

[Aditya Varma @ddavarma_]

@thesimaximalist Thank you! The moment that sold me on it is the agent reported 25/25 on its own tests, the hidden hold out said 7/8, and it fixed it on the next pass with only the test name as feedback and All the run logs are in the repo if you want to poke at them

[John Ternus @johnternus]

We’re glowing with excitement over the new MacBook Pro. You’ve gotta touch it to believe it.

[mallik arjun @NimmagaddaXai]

Huge thanks to @HyundaiIndia for including a complimentary 'NCAP-style Drop Test' during my car's routine service. Didn't realize they were so committed to safety innovation! Can someone confirm if my car passed this extreme lateral impact assessment?
​@GlobalNCAP @TeamBHPforum

[Andrej Karpathy @karpathy]

I am unreasonably excited about self-driving. It will be the first technology in many decades to visibly terraform outdoor physical spaces and way of life. Less parked cars. Less parking lots. Much greater safety for people in and out of cars. Less noise pollution. More space reclaimed for humans. Human brain cycles and attention capital freed up from “lane following” to other pursuits. Cheaper, faster, programmable delivery of physical items and goods. It won’t happen overnight but there will be the era before and the era after.

[Aditya Varma @ddavarma_]

@MKBHD Air blue and orange 17 pro and tech woven case

[Aditya Varma @ddavarma_]

@MKBHD Aluminum 🥲🥲🥲

[Aditya Varma @ddavarma_]

@UbisoftSupport this what is happening to my account please fix this @Rainbow6Game it’s a siege X bug

[Rainbow Six Intel @IntelRainbow6]

GAMEBREAKING BUG!

PC Players are now queueing into CONSOLE RANKED lobbies due to a Siege X bug.

If you are a Console player, it is recommended to not queue Ranked until this bug is fixed

Video 1: @KudosOnYT
Video 2: u/HomieCracked (Reddit)
Photo: u/GavinIsAFox (Reddit)

[Aditya Varma @ddavarma_]

@UbisoftSupport Hey! @UbisoftSupport my rank is getting updated on console account even though I’m playing it on pc and never logged on to a console.🥲🥲🥲

[Aditya Varma @ddavarma_]

Hey! @UbisoftSupport @Rainbow6Game

My rank is not updating I’m stuck in bronze V after playing 3 matches today after the update🥲🥲

[Aditya Varma @ddavarma_]

Hey @UbisoftSupport , I’m not able to report an issue on https://t.co/wxk9vP5nX5 on liver server. It asked me to login, it won’t let me log on after two step verification it says internal error.

[Aditya Varma @ddavarma_]

@svpino Can’t open the link @svpino

[Aditya Varma @ddavarma_]

I updated to iOS 18.1 and why do I need to join waitlist to use Apple intelligence features🥲🥲 this is bad @Apple . Still no glowing Siri🤦‍♂️

[Yann LeCun @ylecun]

@elonmusk It is not journalists who are "extremely left wing", it is you who are extremely right wrong.

[Aditya Varma @ddavarma_]

@ashishllm Please reply to my dm🥲

[Aditya Varma @ddavarma_]

@eljakeo30 What location ?

[Aditya Varma @ddavarma_]

@DKlandscapes @BelindaKARE11 Can you share the location? I live in St Paul