Introducing our RECON benchmark in partnership with @hud_evals
RECON is the first benchmark dedicated to the people research needed for due diligence, fraud investigations, and data enrichment
Sixtyfour's XHigh ranked first among the systems evaluated, with +70.6% weighted accuracy
Here’s how the evaluation worked 🧵
We partnered with @sixtyfourai to release RECON, a benchmark for people research. Agents get a name and a few identifying details, then have to find hard-to-find facts about that person: 514 facts across 140 real people.
Across 22 systems, precision was close (56–86%), but recall wasn't (8–84%). Most misses were unanswered fields, not misidentified information.
Sixtyfour XHigh ranked #1 at 70.6% weighted accuracy, and High ranked #2 at 54.3%.
We ran Sixtyfour on Exa’s people and company search benchmarks.
82.8% of our people search results matched the criteria. Exa’s published score: 63.3%.
That is roughly 20 more relevant people for every 100 results.
We came out ahead on all six measures in the chart.
Introducing the world's first way to screen for fraud on platforms you shop from every day.
Every marketplace runs on sellers it has never met. Sellers sign up under stolen identities, post fake listings, and slip back under new accounts after a ban. Now our agents catch them automatically, work that used to take manual investigation.
Seller fraud used to slip through. Now it turns red with our agents.