Excited to see momentum in agent search research ๐
Interested in this area? Submit to AgentSearch @ SIGIR 2026
๐ Deadline: May 8 (AoE)
https://t.co/aW69s0VAsC
๐ New paper: AgentSearchBench โ a benchmark for AI agent search in the wild.
As agent ecosystems grow, a fundamental question emerges: how do we find the right agent for a task?
We build a benchmark with ~10k real-world agents and show:
โข Semantic similarity โ agent performance
โข Description-based ranking often underestimates capable agents
โข Execution-aware probing improves ranking
๐ Paper: https://t.co/lXJjpqTvCM
Joint work with Arastun Mammadli @arastunmammadli (co-first author) and Xiaoyu Zhang, Emine Yilmaz @emine_yilm at the UCL AI Center @ai_ucl and UCL Computer Science @uclcs
#AI #Agents #LLM #InformationRetrieval
Topics include (but are not limited to)
- Representation and discovery of agents/tools
- Retrieval, ranking, and recommendation of agents/tools
- Evaluation and benchmarking for agent/tool search
- Responsible and human-centered agent/tool search
The workshop co-organizers Bin Wu @binwu_cs and Prof. Emine Yilmaz are from UCL Computer Science @uclcs and UCL Centre for Artificial Intelligence @ai_ucl . We appreciate the institutional support.
๐ข CFP: AgentSearch@SIGIR 2026
Submit your work on indexing, retrieval, and ranking of AI agents & tools.
๐ Extended abstracts (2p) & papers (4โ9p)
๐ Deadline: Apr 15, 2026 (AoE)
๐ https://t.co/aW69s0VAsC
#SIGIR#InformationRetrieval#AIagents
We invite submissions on topics including:
โข Agent/tool discovery
โข Retrieval & ranking of agents
โข Evaluation & benchmarking
โข Responsible & human-centered agent search
Submissions: extended abstracts (2p) or research/perspective/demo papers (4โ9p).
๐ AgentSearch Workshop @ ACM SIGIR โ26
Weโre excited to announce AgentSearch: The First Workshop on Indexing, Retrieval, and Ranking of AI Agents, co-located with ACM SIGIR 2026 (Melbourne | Naarm, Australia).
As AI agents rapidly proliferate, how can users, developers, and multi-agent systems reliably identify and select the "right" agents or tools for a given task?
๐ https://t.co/nquvibmVK9
๐ฆ @AgentSearchIR
๐ฆ https://t.co/n1F1aFUaKQ
Organizers:
Bin Wu @binwu_cs (University College London),
To Eun Kim @TEKnologyy (Carnegie Mellon University),
Yue Feng @YueFeng__ (University of Birmingham),
Fernando Diaz @841io (Carnegie Mellon University),
Zhaochun Ren @zhaochun_ren (Leiden University),
Emine Yilmaz @emine_yilm (University College London & Amazon)
#SIGIR #SIGIR2026 #InformationRetrieval #AIAgents #MultiAgents #AgentSearch