e2e + jev from @typesafeai ⚡
I'm building an open-source framework for running e2e tests with agents. supports web, mobile (and more!)
available soon: https://t.co/G3XB2L8tiC
Before you write good evals, you have to pick the right things to evaluate. Main take-aways:
- source metrics from failures you see in traces
- keep the set small and maintainable
- only keep a metric if you'd take action when it moves https://t.co/G2FZjfidrb
I talk to engineers at other companies every day and hear the same thing: one person is 10x'ing their output with Claude but the rest of the org hasn't caught up.
Watching teams adopt AI, I keep seeing the same 4 steps.
I mapped them out here: Steps of AI Adoption https://t.co/kQnRAUMKpP
Prediction: In the AI age, taste will become even more important. When anyone can make anything, the big differentiator is what you choose to make.
https://t.co/3GQUlfH58t