专业能力也体现在设计问题,让不专业的人能给出有用的反馈。
如果两个方案都超出他的理解,他只能凭感觉选一个。
配眼镜的时候,验光的关键是,每次只改变一个变量,让你回答一个你有能力判断的问题,再由专业知识解释这个答案。
对应到 Agent,好的交互应该让每一轮都缩小不确定性。用户不必先学会写专业需求,系统可以把他的反馈逐步转成需求。但偏好和正确性仍要分开:用户能判断哪个更符合自己的意图,代码到底对不对,还得靠测试。
好的产品是和用户在一起,observe what they did in the product environment。
the most common failure case I see is when people are working outside their domain of expertise and don't know how to be precise with their prompts and plans, so they have to spend a lot of turns iterating imprecisely