programming since AI has been the most miserable. you cannot not use AI because AI lets you do way more. but then you have to live with bullshit like the AI replacing a 10s limit by 150s without telling you and you only finding out 2 weeks later, at the fucking launch day
this is not a thing that ever happened in my programming career, that your code would randomly get damaged and regress in spuriously terrible ways. not the least competent human would do shit like this
and there is no way out. whenever I decide not to use AI, I get slower. I realize I'm shipping a project way larger and more ambitious than whatever I could do before. I depend on it. yet, every time I embrace AI my mental health is slowly consumed by the sheer amount of retarded shit like this, I have to handle at a daily basis
so programming has just became... miserable
I really truly hope Bend solves that problem in practice for me at least, that I only maintain proof-based specs that AI can't touch, and that I never ever ever ever again have to touch another programming language in my fucking life
why would it replace this fucking constant
there goes another fucking day of damage repair
I hate this so fucking much
Anthropic Engineer:
"The biggest mistake in AI right now - people are building graphs and loops without self-improving eval agent
We made that mistake at Anthropic - It cost us 2 years"
here's how he build it, step by step:
step 1 → take 50 real user prompts - run your agent - if it passes 80%+, your eval is too easy - sweet spot is 50%
step 2 → every failed run is a transcript - feed it to Haiku: "what went wrong?" - your eval set builds itself for free
step 3 → score two things: right answer AND right path - right answer, wrong path = breaks next week
step 4 → new model drops, run the same eval - his +9% was fake - 6% was the model dodging a bug - the transcript caught it, the dashboard didn't
step 5 → plug evals into CI - no green evals = no deploy - this is the loop that fixes itself
99% people never did this - but it pays for itself on day one
save this and build it today - full graph engineering guide in the article below ↓
@claudeai u guys are all talking about this and that and value not being there. but for me, anthropic was there for me when nobody else was. backstabbing a company the minute it stumbles is as of a shit hunan behaviour as it can get