I've been experimenting with how AI agents can use web apps better. I'm not going the WebMCP route: there, every action you want agents to use has to be exposed as a tool, so you end up building a second interface next to the app.
I wanted to see how far the boundary can be pushed. Is a better agent loop enough? Is better accessibility enough? And even if they are, what about cost and speed?
I'm working on a different approach. It needs some work on the app's side, not just the agent, but no tool per action like WebMCP, and the app's features and business logic stay as they are. To the people using it, the app looks and works almost exactly the same.
It held up on a few test apps, but I wanted to know how it does on a real application, so I ran it on Umami (open-source analytics). There were 20 tasks: answering questions, making changes, and some tasks that can't be done at all. Each ran 3 times. Every agent used the same model, Claude Haiku 5.5, with its own default settings.
Even part of it helps an agent I didn't build. The full approach costs less than half as much as agent-browser on its own, takes less than half the time, and needs about half the model calls.
Next I'll try a few more real applications, then open-source it, with the full breakdown of what each part contributes.
@itsmeriyapal Faster at making mistakes. That can be good if the person learns something from it. If the person completely offloads thinking to AI then it is just waste of time and token
In terms of direct monetary value not yet but inderictly yes. Can finish work faster and spend time learning more and finally started building something of my own. Got connected with some vcs, great peers. Will release one project soon. Only then can say about direct monetary value.
@Kedeodev Yes for some. Routine monotonous debugging is handled by ai. But I do check sometimes and many times i found better approach that does not just solve that issue but improves overall layer too.
@devcauemoreira Knowing what the code is doing and why and how to optimize it or suggest better approach. There is a reason why I go to restaurant even though I can make some eadable food