1980 | Full Professor of Natural Language Processing (@TMLeiden), @LIACS @UniLeiden | Lives in #Nijmegen | Mother of 2 | ๐ฉ๐ปโ๐ป๐ฉ๐ปโ๐ซ๐คนโโ๏ธ๐ฑ ๐ผ
Domain-specific Information Retrieval
@suzan et al. present a monograph on search in the legal, health and biomedical, academic, and patent domains, covering tasks, datasets, long-document challenges, retrieval methods, and the role of LLMs.
๐ https://t.co/24Zr6LICf9
How long does a finding about LLMs stay true?
We re-tested 50 widely cited findings about LLM behavior (various biases, hallucination, etc). Within 15 months, most no longer held or had substantially reduced effects.
LLM findings has short shelf life https://t.co/MUWm6INyX8
Great job by @oq_35!
In the first step of a roadmap to bring Anthology search in-house, we have implemented an author index, accessible both from the main page navigation bar and from the people page: https://t.co/ZMiCsbh3Li.
Okay so, we just found that over 50 papers published at @Neurips 2025 have AI hallucinations
I don't think people realize how bad the slop is right now
It's not just that researchers from @GoogleDeepMind, @Meta, @MIT, @Cambridge_Uni are using AI - they allowed LLMs to generate hallucinations in their papers and didn't notice at all.
It's insane that these made it through peer review๐
Happy to share that our paper "Generative Retrieval with Few-shot Indexing" has been accepted at #ECIR2026, with @arian_ask, @maliannejadi, @zhaochun_ren, Evangelos Kanoulas and @suzan.
A training-free generative retrieval method with strong performance and much faster indexing
Ik wilde weten waarom Elon Musks chatbot Grok onlangs compleet ontspoorde, allerhande antisemitische stereotypen begon uit te braken, en zichzelf MechaHitler begon te noemen. Wat blijkt: het rabiate buitenbeentje onder de chatbots is gewoon zo getraind. https://t.co/lHlHxDhZFU
Huge congratulations to @macavaney on receiving the prestigious ACM SIGIR Early Career Researcher Award in the research category! This well-deserved recognition highlights the excellence & impact of his work in the IR community ๐๐#sigir2025
Cc @GlasgowCS@UofGlasgow@ACMSIGIR
The #SIGIR2025 Best Paper just awarded to the WARP engine for fast late interaction!
Congrats to Luca Scheerer๐ WARP was his @ETH_en MS thesis, completed while visiting us at @StanfordNLP.
Incidentally, it's the fifth Paper Award for a ColBERT paper since 2020!*
Luca did an incredible job leading and executing this. See the thread below for some relevant links.
*Though it's notable that this is actually the first among these awards with ColBERT(v1/v2) authors๐ ๐
Shameless self-promotion! Check out the book on #GenIR edited by @ryen_white and me (with 9 chapters written by highly distinguished scholars) at the @SpringerNature booth at #SIGIR2025 https://t.co/580v60z9bp
Wow, honored to be named an Excellent PC Member at @SIGIRConf!
Glad my obsessive... I mean detailed... reviewing style paid off. ๐คโจ
Huge thanks to the chairs for the recognition and congrats to all the other reviewers!
#SIGIR#SIGIR2025#Award#BestReviewer
A good thought-provoking panel at the start of @SIGIRConf 2025 #SIGIR2025 "Is Search Dead? The Rise or Demise of Search in the Era of LLMs". Many valuable points on the topic from an excellent team of panelists.
Suspect some of this has now been implemented with AI Overviews. Looking forward to more thoughts from IR professors at this year's European Summer School for Information Retrieval next week.
If, due to exceptional circumstances, you are not able to travel to Padua to present your paper, please contact the chairs at [email protected] on May 30th CEST the latest to discuss possible solutions.
https://t.co/WT0g6K51U4
In only two years LLM-based relevance assessment has gone from rejections because itโs crazy and dangerous to rejections because it is boring and standard.