@UW@hideo_joho@preetams7 Great to see @preetams7 and Tanya Roosta leading an engaging session on Information Seeking in the Age of Agentic AI. π€π‘
(2/2)
π Tutorial details:
https://t.co/YeAuvHvAab
π Conference registration:
https://t.co/QGQs3srxi5
If youβre interested in IR, HCI, agentic AI, or the future of search and decision support, weβd love to have you join us.
#IR#AgenticAI@ACM_CHIIR@infoseeking1
(1/2)
π¨ CHIIR 2026 registration is now open!
Our tutorial, Information Seeking in the Age of Agentic AI, examines how AI systems are shifting from supporting search to actively doing the seeking on usersβ behalf, and what this means for design and evaluation in practice.
Dynamic-KGQA tackles this by dynamically generating test samples, reducing leakage & making evaluations more robust and closer to real-world performance.
More details here:
π https://t.co/XvyctopMXC
π https://t.co/92E9InRpWa
π Giotto Hall | π 2 PM | @SIGIRConf
Excited to present at #SIGIR2025!
Dynamic-KGQA: Framework for Generating Adaptive QA Datasets
(@HimanshuJNaidu, @chirag_shah)
With generative models trained on anything & everything, static datasets often leak into pretraining β blurring the line between capabilities & memory.
Our team has a couple of intern papers at SIGIR 2024. Great work by Preetam Dammu (UW) and Diji Yang (UCSC). @AmazonScience
Answering scoring framework for LLMs
https://t.co/SE9zENU0C2
Question intent taxonomy https://t.co/wkx3LA0HiO
Despite much noise and work on #alignment, it is amazing how brittle still #LLMs are. It doesn't take much effort to bring out their ugly biases if one probes beyond popular topics of gender, race and religion.
Our new study explores #caste biases in job interview settings.
5/ Our findings raise concerns regarding the suitability of LLMs in sensitive applications, such as recruitment, conversation generation, and screenplay-writing/script generation, which may generate texts containing CHAST. Preprint: https://t.co/2axTFst9Fl
LLMs are known to generate harmful views, but what are the various and potentially covert forms of harm and identity threats in LLM-generated conversations?
We explore this with @hayounggjung, @anjali_singh35, @monojitchou, and @tanmit. Preprint: https://t.co/2axTFst9Fl
4/ We found that multiple LLMs generated malign views in seemingly neutral language, unlikely to be detected and flagged by SOTA tools such as PerspectiveAPI. Our method, by contrast, is specifically designed to capture these covert harms.