TREC Tip-of-the-Tongue Track

TREC Tip-of-the-Tongue Track focuses on known-item identification where the searcher cannot recall a reliable identifier (i.e., "It’s on the tip of my tongue…")

[TREC Tip-of-the-Tongue Track @TREC_ToT]

Hello TREC-ToTers! 👋🏽

📆 Good news! We are extending the run submission deadline by 2 weeks. Please submit your runs by **September 10 (Wednesday)** and spread the word.

More info: https://t.co/EoL6aN5NTD
#TREC2025 #TRECToT #TREC2025ToT

[TREC Tip-of-the-Tongue Track @TREC_ToT]

Important announcement: All run submissions for the TREC'25 Tip-of-the-Tongue (TREC-ToT) Track are due by **August 27th**.

The run submission form is now open. Please submit your runs before the deadline.

More information: https://t.co/EoL6aN5NTD
#TREC2025 #TRECToT #TREC2025ToT

[Bhaskar Mitra | ভাস্কর মিত্র @UnderdogGeek]

**NTCIR Tip-of-the-Tongue Shared Task**
Participate in Chinese, Japanese, Korean, and/or English. #NTCIR2026 #NTCIRToT #NTCIR2026ToT

Registration deadline: June 1
Runs submission deadline: July 30
Guidelines: https://t.co/fPhSZUIz9x
Register: https://t.co/YFFueipzdK

See 🧵...

[Bhaskar Mitra | ভাস্কর মিত্র @UnderdogGeek]

It's deadline day! 🏃🏾‍♂️🏃🏾🏃🏾‍♀️ #TREC2025 #TRECToT #TREC2025ToT

[Bhaskar Mitra | ভাস্কর মিত্র @UnderdogGeek]

⏰ Gentle reminder: Run submission deadline for TREC'25 Tip-of-the-Tongue (ToT) Track is end-of-day **Wednesday (Sep 10)** Anywhere-on-Earth (AoE). Please make sure to submit your runs before the deadline.

Guidelines: https://t.co/F0fgkBAB0M
#TREC2025 #TRECToT #TREC2025ToT

[Danny To Eun Kim @TEKnologyy]

Tip of the Tongue retrieval shared task is coming to Tokyo!

[TREC Tip-of-the-Tongue Track @TREC_ToT]

We are coming to Tokyo!!! ✈️

[Bhaskar Mitra | ভাস্কর মিত্র @UnderdogGeek]

Some exciting news! 🤗 After 3 amazing years at TREC, the Tip-of-the-Tongue (ToT) shared task will be a core task at NTCIR-19 in 2026. The new track will focus on ToT information needs in English and East Asian languages.

More details coming soon. See you all in Tokyo next year!

[Bhaskar Mitra | ভাস্কর মিত্র @UnderdogGeek]

📆 Please note the deadline extension for #TREC2025 Tip-of-the-Tongue (ToT) Track!

Track guidelines: https://t.co/F0fgkBA3be
#TRECToT #TREC2025ToT

[Bhaskar Mitra | ভাস্কর মিত্র @UnderdogGeek]

Gentle reminder 📢
All run submissions for the Tip-of-the-Tongue (ToT) Track are due next week Wednesday (Aug 27).

More info: https://t.co/F0fgkBA3be
#TREC2025 #TRECToT #TREC2025ToT

[Bhaskar Mitra | ভাস্কর মিত্র @UnderdogGeek]

Hello TREC-ToTers! 👋🏽

Please note that the deadline for run submissions this year is **Aug 27**. Please spread the word! 🙏🏽

[Danny To Eun Kim @TEKnologyy]

This year's TREC Tip of the Tongue track will be amazing! Based on our rigorous experiments on synthetic ToT query generation presented at #SIGIR2025, we extended the track to open domain ToT queries. We provide codes for baseline systems, and submissions are due by August 27th!

[TREC Tip-of-the-Tongue Track @TREC_ToT]

Important announcement: All run submissions for the TREC'25 Tip-of-the-Tongue (TREC-ToT) Track are due by **August 27th**.

The run submission form is now open. Please submit your runs before the deadline.

More information: https://t.co/EoL6aN5NTD
#TREC2025 #TRECToT #TREC2025ToT

[TREC Tip-of-the-Tongue Track @TREC_ToT]

Hello TREC-ToTers!

We have released the test queries for the TREC 2025 Tip-of-the-Tongue (TREC-ToT) Track. Please see the guidelines for more information: https://t.co/EoL6aN5NTD. Run submission deadline will tentatively be in August. #TREC2025 #TRECToT #TREC2025ToT

[Bhaskar Mitra | ভাস্কর মিত্র @UnderdogGeek]

📣📣📣

[TREC Tip-of-the-Tongue Track @TREC_ToT]

Hello TREC-ToTers!

We have released the test queries for the TREC 2025 Tip-of-the-Tongue (TREC-ToT) Track. Please see the guidelines for more information: https://t.co/EoL6aN5NTD. Run submission deadline will tentatively be in August. #TREC2025 #TRECToT #TREC2025ToT

[TREC Tip-of-the-Tongue Track @TREC_ToT]

Hello TREC-ToTers! 👋🏽

Excited to announce the release of TREC 2025 Tip-of-the-Tongue (TREC-ToT) Track guidelines: https://t.co/EoL6aN5NTD. We will release test queries in July and run submission deadline will be in August. #TRECToT #TREC2025ToT

Please register to participate:

[Maik Fröbe @maik_froebe]

Do not forget to participate in the #TREC2025 Tip-of-the-Tongue (ToT) Track :)

The corpus and baselines (with run files) are now available and easily accessible via the ir_datasets API and the HuggingFace Datasets API.

More details are available at: https://t.co/VKM5P4ELcT

[TREC Tip-of-the-Tongue Track @TREC_ToT]

Hello TREC-ToTers! 👋🏽

Excited to announce the release of TREC 2025 Tip-of-the-Tongue (TREC-ToT) Track guidelines: https://t.co/EoL6aN5NTD. We will release test queries in July and run submission deadline will be in August. #TRECToT #TREC2025ToT

Please register to participate:

[Bhaskar Mitra | ভাস্কর মিত্র @UnderdogGeek]

Please share the word and register to participate!
#TREC2025ToT

[TREC Tip-of-the-Tongue Track @TREC_ToT]

Hello TREC-ToTers! 👋🏽

Excited to announce the release of TREC 2025 Tip-of-the-Tongue (TREC-ToT) Track guidelines: https://t.co/EoL6aN5NTD. We will release test queries in July and run submission deadline will be in August. #TRECToT #TREC2025ToT

Please register to participate:

[Danny To Eun Kim @TEKnologyy]

These approaches powered the TREC 2024 TOT track test queries and will continue into the 2025 track (https://t.co/upLIuTa2RT).
Joyful collaboration with Yifan He, @841io, Jaime Arguello, and @UnderdogGeek!
#SIGIR #TREC #TOT

[Danny To Eun Kim @TEKnologyy]

📂 Our Code & Data
🔗LLM-Elicitation: https://t.co/L86itF55yO
🔗Human query collection interface with visual stimuli set: https://t.co/48hzimFbiD

[Danny To Eun Kim @TEKnologyy]

⚡️Multi-Domain Coverage
Combining both methods allows TOT query evaluation in multiple domains. We tested simulated evaluation in Movie, Landmark, and Person domains. Moreover, we build a broader, more inclusive TOT test collection.