NTCIR

NTCIR organizes shared-tasks in IR, QA, MT, NLP, Summarization, Data/Opinion Mining.

[NTCIR @NTCIR]

📅 Registration deadline: July 10, 2026 (AoE)
🔗 Task: https://t.co/ySpleMWoPY (moved from Google Sites)
📧 [email protected]
📝 Register: https://t.co/e8kMa7PDVm
#NTCIR19 #MultimodalIR #Ecommerce (4/4)

[NTCIR @NTCIR]

🧵 "Show me a dress like this but in blue and shorter." Composed image retrieval is a hard, real-world problem. #NTCIR19 CAMEO benchmarks it using 369,000+ reviews from a real Vietnamese e-commerce platform. (1/4)

[NTCIR @NTCIR]

The ViEcomRec dataset is built from a real Vietnamese e-commerce platform, with product images, metadata, and 369K+ Vietnamese customer reviews. Retrieved images are pooled TREC-style across submissions and judged by human assessors. (3/4)

[NTCIR @NTCIR]

📅 Registration deadline: July 10, 2026 (AoE)
🔗 Task: https://t.co/UWswf4WWom
📝 Register: https://t.co/e8kMa7PDVm
#NTCIR19 #Lifelogging #PersonalIR (5/5)

[NTCIR @NTCIR]

🧵 What if you could search your own memories? That’s the vision behind #NTCIR19 Lifelog-7. The task features four subtasks, including the new CASTLE collection with audio, video, chat transcripts, and interaction logs supporting three retrieval challenges. (1/5)

[NTCIR @NTCIR]

The dry run is Feb 20 – May 1. Formal run: Apr 20 – Aug 1. Registration deadline July 10. This is the 7th edition of the NTCIR Lifelog series. (4/5)

[NTCIR @NTCIR]

📅 Registration: June 1, 2026 | Formal run submission: July 19, 2026
🔗 Task: https://t.co/p7f2dl0MfM
📦 Data: https://t.co/llrXvbbV8x
📝 Register: https://t.co/e8kMa7PDVm
https://t.co/Iuk89li0Se
#NTCIR19 #ScientificNLP #FactVerification (5/5)

[NTCIR @NTCIR]

🧵 "Table 1 shows our method outperforms all baselines." Does it? #NTCIR19 SciClaimEval is a benchmark for verifying scientific claims against the actual tables and figures in papers. (1/5)

[NTCIR @NTCIR]

Published baselines: o4-mini achieves 82.3% accuracy but only 68.2% pair accuracy on subtask 1 and 85.2% on subtask 2. Qwen3-VL-30B also tested. Dataset is live on HuggingFace now. (4/5)
https://t.co/yZibKcMaaX

[NTCIR @NTCIR]

📅 Registration deadline: July 10, 2026 (AoE)
🔗 Task: https://t.co/QWifF2pUUN
📧 [email protected]
📝 Register: https://t.co/e8kMa7PDVm
#NTCIR19 #MedicalAI #XAI (5/5)

[NTCIR @NTCIR]

🧵 An AI radiologist writes "pneumonia." But what findings led there? AI usually skips that reasoning. #NTCIR19 HIDDEN-RAD2 challenges systems to make it explicit — and now to catch their own mistakes too. (1/5)

[NTCIR @NTCIR]

Two participation tasks:
• Radiologist-annotated reports (+ optional imaging data)
• Crowdsourced questionnaires — no licensing restrictions, broader access
Evaluation: automatic metrics + domain embeddings + LLM rubric scoring + expert qualitative review. (4/5)

[NTCIR @NTCIR]

📅 Registration deadline: June 1, 2026 (AoE)
🔗 Task: https://t.co/VAjxjKQuNP (site has moved!)
📝 Register: https://t.co/e8kMa7PDVm
#NTCIR19 #ModelSelection #MLOps (4/4)

[NTCIR @NTCIR]

🧵 Advances in AI have led to a proliferation of pre-trained models across many domains. But selecting the right model for a new task remains costly and time-consuming. #NTCIR19 ModelRetrieval frames this challenge as an information retrieval problem. (1/4)

[NTCIR @NTCIR]

You may (or may not) actually fine-tune models — any approach that predicts rankings without exhaustive experimentation is valid. But your methodology must be documented in your paper. Ground truth: organizer-run fine-tuning results. (3/4)