AI agents are bad at hiding info. We developed a solution to keep data out of context.
Taco Bell rolled out an AI drive-thru and it took an order for 18,000 cups of water. Air Canada got sued because their chatbot made up a refund policy and they had to honor it.
@FishAudio Let's say someone builds a receptionist that knows the pricing or internal notes ... how do you stop it from just saying all of it on a call?
@omarsar0 Agreed! Building voice roleplays at TrackPoint, the voice sounding human is almost solved now. The hard part is what the agent says... and what it should never say. What are you using them for?
@emollick Makes sense... but would labs really want to compete with their own biggest API customers? Feels like thatβs the moment devs start hedging with open models.
@trailofbits@OpenAI Seems like Test Driven Development is perfect for AI-based development. Do as much developer as needed to make tests pass :)
And then write more tests