TREC RAG @ 2026

Official Twitter account for the TREC RAG Tracks (2024 & 2025 & 2026)!

[TREC RAG @ 2026 @TREC_RAG]

Does retrieval help RAG or did the LLM already memorize the answer? 🤔 Too often, the overlap between RAG corpora and what LLMs “know” is unclear

Better RAG evaluation needs tighter alignment between NLP and IR

📚 That's why for RAG 2026 we are using @nvidia's ClimbMix corpus

[TREC RAG @ 2026 @TREC_RAG]

🤔 What kind of metrics do you think accurately measure retrieval for agentic search?

Interested? Don’t forget to:
1️⃣ Sign up for TREC: https://t.co/uqDO2Vucrd

2️⃣ Join our mailing list: https://t.co/90jtWJdi6S

3️⃣ Join us on SIGIR Slack!

Stay tuned for more updates soon! 🚀

[TREC RAG @ 2026 @TREC_RAG]

Search is no longer just a ranked list...LLM agents can now query, inspect, reformulate, and decide when to stop 🤖

At TREC RAG 2026, we’re introducing new metrics for agentic search: evaluating not only final results, but the search process itself 📊

Stay tuned!

[TREC RAG @ 2026 @TREC_RAG]

Interested? Don’t forget to:

1️⃣ Sign up for TREC: https://t.co/uqDO2Vucrd
2️⃣ Join our mailing list: https://t.co/90jtWJdi6S
3️⃣ Join us on SIGIR Slack!

Stay tuned for more updates soon! 🚀

[TREC RAG @ 2026 @TREC_RAG]

🤨 Is your agent confused about what to build because it says there aren’t any guidelines?

Now your agent has no more excuses - track guidelines for TREC RAG 2026 are out 🔥

And yes, they’re available via SKILLz 😎

Tell your agents to showcase your agentic search system!

[TREC RAG @ 2026 @TREC_RAG]

🤝 As we always say: progress is best through collaboration.

This is still a work in progress, and we’d love your feedback.

Guidelines can be found here: https://t.co/mb5GxgTOIz

[TREC RAG @ 2026 @TREC_RAG]

Interested? Don’t forget to:

1️⃣ Sign up for TREC: https://t.co/uqDO2Vucrd
2️⃣ Join our mailing list: https://t.co/90jtWJdi6S
3️⃣ Join us on SIGIR Slack!

Stay tuned for more updates soon! 🚀

[TREC RAG @ 2026 @TREC_RAG]

Does retrieval help RAG or did the LLM already memorize the answer? 🤔 Too often, the overlap between RAG corpora and what LLMs “know” is unclear

Better RAG evaluation needs tighter alignment between NLP and IR

📚 That's why for RAG 2026 we are using @nvidia's ClimbMix corpus

[TREC RAG @ 2026 @TREC_RAG]

In the meantime, what can you expect in the coming weeks? 👀

We will be providing ClimbMix 🧗‍♂️ “projected” relevance assessments for RAG 24/25 topics so you can begin evaluating your RAG systems, along with baseline RAG systems 📊

[TREC RAG @ 2026 @TREC_RAG]

Interested? Play around with the SKILLz here 👇
https://t.co/I4R5XxS4tP

What else can you do in the meantime? 🫵

1️⃣ Sign up for TREC (https://t.co/uqDO2Vucrd)!
2️⃣ Join our mailing list (https://t.co/90jtWJdi6S)
3️⃣ Join us on SIGIR Slack!

So...how well can your agent do? 👀

[TREC RAG @ 2026 @TREC_RAG]

TREC RAG is returning for 2026! 🎉

This year’s iteration is special because agents 🤖 can join the fun… but what might agent-first community evaluation look like? 🧵👇

[TREC RAG @ 2026 @TREC_RAG]

🤝We believe in progress through collaboration

💬Please test out the SKILLz ⛹️and give us your thoughts and feedback!

Your insights will play a pivotal role in shaping the TREC 2026 RAG track!

[Nandan Thakur @beirmug]

TREC RAG 2025 official retrieval baselines are available now! 💥💥💥

Time to start generating those answers and submit them to eval base before August 17th! 🗓️

Let the games begin, well you have less than a month remaining to submit! 🍻