Excited to be at #ICML2026 in Seoul! ๐ฐ๐ท
Iโll be presenting our work With Argus Eyes: Assessing Retrieval Gaps via Uncertainty Scoring to Detect and Remedy Retrieval Blind Spots.
How can we know when a retriever is likely to fail โ before it misses the information we need?
In this work, we explore how to uncover retrieval blind spots and use uncertainty signals to guide targeted improvements in retrieval systems.
If you are attending ICML, I would be happy to meet, discuss retrieval, reasoning, our work, and hear your thoughts. Come by our poster! โจ
๐ Paper: With Argus Eyes: Assessing Retrieval Gaps via Uncertainty Scoring to Detect and Remedy Retrieval Blind Spots
๐ Location: HALL A โ No. 1502
๐๏ธ Time: Thursday, July 9 โข 10:30 AM โ 12:15 PM KST
๐ Paper & Code:
arXiv: https://t.co/whVByWCfQI
GitHub: https://t.co/dOrvyDddBI
#ICML #InformationRetrieval #MachineLearning #NLP #LLMs
If you're at #ICML2026 ๐ฐ๐ท next week, don't miss our latest work on remedying retriever blind spots! ๐
@zeinabTaghavi is presenting our paper at the conference. I unfortunately won't be there to join, but you should definitely go check out the poster, and chat with her! ๐ [1/3]
๐ Excited to share our new paper accepted at ICML 2026!
๐ Did you know retrievers can have their own blind spots-where certain documents are consistently hard to retrieve?
๐ Retrieval failures are not random; some documents are consistently hard to retrieve.
๐ We introduce RPS to quantify retrievability and show it can be predicted from embeddings before indexing.
๐ ๏ธ ARGUS detects these blind spots and mitigates them with targeted augmentation.
๐ We observe consistent gains in retrieval performance (+3.4 nDCG@5, +4.5 nDCG@10 on average).
๐ค Grateful to work with an amazing team: @AModarressi , @HinrichSchuetze , and @amarfurt, at @CisLmu and @hslu.
๐ป Code, supplementary materials, and reimplementations: https://t.co/knvjqY1uaO
๐ Paper: https://t.co/6Y68KIe3Dn
#ICML2026
#ICML
#Trustworthy
#RAG
#InformationRetrieval
Check out our new collab with @ZeinabTaghavi, accepted at #ICML2026!๐
Dense retrievers have blind spots (see: Collapse of Dense Retrievers & ImpliRet; both worth a look ๐). ARGUS detects them from embeddings before indexing and mitigates them with targeted augmentation.
๐ Excited to share our new paper accepted at ICML 2026!
๐ Did you know retrievers can have their own blind spots-where certain documents are consistently hard to retrieve?
๐ Retrieval failures are not random; some documents are consistently hard to retrieve.
๐ We introduce RPS to quantify retrievability and show it can be predicted from embeddings before indexing.
๐ ๏ธ ARGUS detects these blind spots and mitigates them with targeted augmentation.
๐ We observe consistent gains in retrieval performance (+3.4 nDCG@5, +4.5 nDCG@10 on average).
๐ค Grateful to work with an amazing team: @AModarressi , @HinrichSchuetze , and @amarfurt, at @CisLmu and @hslu.
๐ป Code, supplementary materials, and reimplementations: https://t.co/knvjqY1uaO
๐ Paper: https://t.co/6Y68KIe3Dn
#ICML2026
#ICML
#Trustworthy
#RAG
#InformationRetrieval
Couldn't make it to ICLR in person this year, but our work is there! ๐ Stop by Poster #603 tomorrow if you're around ๐
Really proud of this collab w. @mohsen_fayyaz : steering MoE model behavior by flipping expert activations at test time.
#ICLR2026
๐ SteerMoE has been accepted to ICLR 2026 and will be presented at Poster #603, Poster Session 2, Pavilion 3, Thu 23 Apr, 3:15โ5:45 p.m.
๐ Iโm unable to attend in person, so many thanks to @LucasBandarkar for presenting on our behalf. Stop by if youโre around.
And a nice interlude that had our audience participate and think critically about AI for AI. And finished with work from @AModarressi et al. on continual learning for LLMs by having it read and write to a memory.
While Iโm attending #EACL2026 virtually, be sure to catch Pedro's presentation at the 11:30โ13:00 session this Wednesday in S. Le Riad! Heโll be discussing our recent collaboration:
๐ "Persistent Personas? Role-Playing, Instruction Following, and Safety in Extended Interactions"
Persistent Personas? Role-Playing, Instruction Following, and Safety in Extended Interactions
[Oral]: Wed. 25 Mar - S. Le Riad @ 11:30-13:00
Pedro Henrique Luz de Araujo, @MicHedderich, @AModarressi, @HinrichSchuetze, Benjamin Roth
https://t.co/4rvLZJVzaT
Going to Rabat for #EACL2026? So are we! ๐ฒ๐ฆ
We are bringing a packed schedule of papers, talks, and workshops.
Check out our lineup below and come say hi! ๐ ๐งต
#NLProc @EACL2026
โ ๏ธ Update: #Iran has now been offline for 96 hours, limiting reporting and accountability over civilian deaths as Iranians protest and demand change; fixed-line internet, mobile data and calls are disabled, while other communication means are also increasingly being targeted โ๏ธ
๐งโ๐ฌIโm recruiting PhD students in Natural Language Processing @UniLeipzig Computer Science, together with @Sca_DS!
Topics include, but arenโt limited to:
๐Linguistic Interpretability
๐Multilingual Evaluation
๐Computational Typology
Please share!
#NLProc#NLP
๐ฅณLife Update!
Iโm thrilled to share that Iโll be starting as assistant professor for Natural Language Processing @UniLeipzig in April! Iโm deeply grateful to everyone who supported me on this journey.
I will be recruiting PhD students with @Sca_DS, stay tuned for the details!
Excited to be here in Suzhou for #EMNLP2025!
Iโll be presenting โImpliRetโ, check out our poster on Friday Nov. 7th at 14:00.
If youโre into long-context, IR, or just want to chat, come *Pay Ali* a visit ๐
Excited to be here in Suzhou for #EMNLP2025!
Iโll be presenting โImpliRetโ, check out our poster on Friday Nov. 7th at 14:00.
If youโre into long-context, IR, or just want to chat, come *Pay Ali* a visit ๐
๐จIntroducing ImpliRet ๐จ
Most reasoning-heavy IR benchmarks focus on complex queries. But what if the reasoning is needed on the document side?๐ค โโOur new benchmark tests retrieval when facts are implicitly stated and it exposes a tough challengeโbest nDCG@10 is only 14.91%
๐ฅNew paper ๐ฅ
MoE experts shape not only domains but also behaviors like safety and faithfulness. Toggling them at inference lets us steer outputs toward safer or more faithful behavior, or bypass guardrails.
Excited to share my collab on @mohsen_fayyazโs work at @AdobeResearch.
๐จ You can bypass ALL safety guardrails of GPT-OSS-120B ๐จโ๐คฏ
How? By detecting behavior-associated experts and switching them on/off.
๐ Steering MoE LLMs via Expert (De)Activation
๐ https://t.co/U2YRyXon4H
๐งต๐
๐ Excited to share that ImpliRet is accepted to the Main Conference of #EMNLP2025!
We introduce a benchmark for reasoning-intensive IR, where retrievers must surface implicit facts hidden in documents across 3 reasoning categories.
๐ https://t.co/iPoW0Tn9Oe
๐ข Paper alert: ImpliRet!
In ImpliRet, we reveal how hard it is for retrievers and even LLMs in RAG/long-context setups to reason over implicit facts hidden in documents.
Proud to share this work with @zeinabTaghavi, alongside Yunpu Ma and @HinrichSchuetze.
๐จIntroducing ImpliRet ๐จ
Most reasoning-heavy IR benchmarks focus on complex queries. But what if the reasoning is needed on the document side?๐ค โโOur new benchmark tests retrieval when facts are implicitly stated and it exposes a tough challengeโbest nDCG@10 is only 14.91%