@kapilansh_twt Anyone refusing to use AI for code generation is living in a cave.
Anyone saying that AI is perfect and you just need one prompt is delusional.
What's needed is a system that enables the verification of what agents have done.
With full history, context and the like.
@davidfowl A new system is needed.
- to verify that what agents built is in fact correct
- to let agents know what broke so that they can correct
- to have history and context
Verification is the need of the hour.
@theo Only thing AI is missing is 'verifying' the output of what it has produced.
e2e tests help but there needs to be a system around it.
Call it verification engineering, proof-driven-development, reliability layer or something else.
But there needs to be a system for that
@theo Only thing AI is missing is 'verifying' the output of what it has produced.
e2e tests help but there needs to be a system around it.
Call it verification engineering, proof-driven-development, reliability layer or something else.
But there needs to be a system for that
@ChShersh To prevent this, you need some sort of evidence capture mechanism, that is searchable and can be handed off to an agent without consuming its full context window.
Do that and you'll ship crazy fast!
@supabase I delegated a task to Claude.
Came back to see the results after an hour.
Only to see that it had asked for a permission 57 minutes ago.
๐ฅฒ
@theo Everyone will move to E2E tests.
At the current volume of code generated by agents, verification is the new bottleneck.
And you can't do that by code review given the volume of PRs.
Plug in some E2E tests and a mechanism to capture and share evidence and you're good to go.
@theo Everyone will move to E2E tests.
At the current volume of code generated by agents, verification is the new bottleneck.
And you can't do that by code review given the volume of PRs.
Plug in some E2E tests and a mechanism to capture and share evidence and you're good to go.