Agent Evaluations are so broken with techbros checking text output and calling it a day
While pitching a potential customer [top 10 Indian auto] they mentioned how the engineering vendor had not hooked up their agent to their CRM completely and it was just spewing random numbers for the last month when asked about services left.
Istg it’s so taxing to try and write thoughtful personalised messages to each potential customer who’s connected with you and AI seems to never get it quite right
Really considering becoming a meat proxy
@GergelyOrosz I think the current range interview methods will assimilate to give birth to a new standard format - much like what DSA was.
Everyone is figuring what that new format will be , it’ll be fine.
It’s not just NVIDIA. Sources confirm Google's Gemini team was also leaking confidential information to China.
China is reportedly asking them to stop.
while evaluating contact centre agents, an important figure to track is % of uncovered intents in production.
a bunch of companies only look at the journeys they wish to fulfil and eval those, ignoring what real customers ask, simply marking them as out of scope.
best example i saw: ~20% of queries on a company's chatbot were about jobs available at their org. made perfect sense to put a careers page link as a reply