MSMarco

Team Account for MSMARCO

[Bhaskar Mitra | ভাস্কর মিত্র @UnderdogGeek]

And drop by our poster this evening and during the breaks. #TREC2023DL #TRECDL #TREC2023

[Bhaskar Mitra | ভাস্কর মিত্র @UnderdogGeek]

If you are at #TREC2023 this morning, then come down to room 3-CD for the TREC Deep Learning Track workshop and don't forget to pick up a TREC Deep Learning Track 5 year celebration sticker!

[MSMarco @MSMarcoAI]

Fifth and final year of the #TREC Deep Learning Track. What an amazing journey this has been, thank you one and all! 🙏 #TREC2023 #TRECDL #TREC2023DL

[Bhaskar Mitra | ভাস্কর মিত্র @UnderdogGeek]

On my way to #TREC2023. ✈️ This is the 1st year of the Tip-of-the-Tongue (ToT) Track and the 5th (& final) year of the Deep Learning (DL) Track. Looking forward to seeing many of you in-person for the first time since the pandemic! #TREC #TRECToT #TRECDL #TREC2023TOT #TREC2023DL

[Bhaskar Mitra | ভাস্কর মিত্র @UnderdogGeek]

🔔 Reminder: The deadline for run submissions for the TREC 2023 Deep Learning Track is in 1 WEEK! #TRECDL #TREC2023DL

[Bhaskar Mitra | ভাস্কর মিত্র @UnderdogGeek]

⌛Gentle reminder: #TREC2023DL Track run submission deadline is **JULY 31**. Get your run submissions in before the deadline! #TRECDL

Guidelines and more info: https://t.co/pyRUKYs87k

[Hossein A. (Saeed) Rahmani @srahmanidashti]

We are pleased to announce that we have released the test queries for the TREC 2023 Deep Learning Track. This year, we have some 'synthetic' queries to explore whether we can glean insights about system performance using queries generated by LLMs.

#TREC #TREC2023DL

[Bhaskar Mitra | ভাস্কর মিত্র @UnderdogGeek]

Are you planning to participate in the TREC 2023 Deep Learning Track? We have just released the test queries! 🙌🏽 #TRECDL #TREC2023DL

Run submission deadline is **JULY 31** (in exactly 3 weeks) 👈🏽

Guidelines and more info: https://t.co/pyRUKYs87k

[Nick Craswell @nick_craswell]

Announcing: Test queries for the TREC 2023 Deep Learning Track are now available, along with top-100s for (optional) use in reranking. #TRECDL #TREC2023DL
@MSMarcoAI https://t.co/ChL846qTsr

[MSMarco @MSMarcoAI]

🔔We are back up again. Sorry ya'll for any inconvenience caused by this.

[MSMarco @MSMarcoAI]

⚠️There is a small ongoing configuration issue with our Azure storage account because of which the MS MARCO and related datasets are currently not accessible. We are actively working on this and hope to bring it back up soon. Sorry for the inconvenience!

[MSMarco @MSMarcoAI]

⚠️There is a small ongoing configuration issue with our Azure storage account because of which the MS MARCO and related datasets are currently not accessible. We are actively working on this and hope to bring it back up soon. Sorry for the inconvenience!

[Bhaskar Mitra | ��াস্কর মিত্র @UnderdogGeek]

The TREC-DL Track will celebrate 5th anniversary this year.🎂 Focus will be on comprehensive passage runs judging and using those for document runs eval. Test queries to be released in June. Submission deadline: July 31st. #TRECDL #TREC2023DL
Guidelines: https://t.co/pyRUKYs87k

[Bhaskar Mitra | ভাস্কর মিত্র @UnderdogGeek]

I'm co-organizing 2 TREC tracks this year: Tip-of-the-Tongue & Deep Learning. Excited that 20+ groups have already registered for each. 🙌🏽#TREC2023 #TREC2023ToT #TREC2023DL #TRECToT #TRECDL

Please Register: https://t.co/iFf8zkLv9z
Also, guidelines for both tracks are now online.

[MSMarco @MSMarcoAI]

Important 🧵

[Bhaskar Mitra | ভাস্কর মিত্র @UnderdogGeek]

Thanks for raising this @macavaney! This is a very important conversation relevant to 3 evaluation scenarios that are worth discussing separately:
1. TREC-DL 2023
2. MS MARCO ranking leaderboard
3. Private evaluation for papers using MS MARCO / TREC-DL data

A quick thread... 🧵

[Bhaskar Mitra | ভাস্কর মিত্র @UnderdogGeek]

Super excited about #TREC'23!🙌🏽 This year is the 5th anniversary🎂 of the Deep Learning Track. #TRECDL I'm also co-organizing the Tip-of-the-Tongue Track, #TRECToT the cool new track😎 at TREC w/ complex and ambiguous information needs. Please participate!
https://t.co/DrtS63vq1w

[Bhaskar Mitra | ভাস্কর মিত্র @UnderdogGeek]

Quick follow-up: Here's our poster summarizing the TREC 2022 Deep Learning track. #TREC2022DL #TREC2022 #TRECDL

[Bhaskar Mitra | ভাস্কর মিত্র @UnderdogGeek]

Was a pleasure to present the 4th Deep Learning Track overview at #TREC2022. We had healthy track participation and observed bigger gaps between trad. and NN based methods, and better distribution of system performances across queries. #TREC2022DL #TRECDL

https://t.co/pyRUKYsFWS

[Bhaskar Mitra | ভাস্কর মিত্র @UnderdogGeek]

Slides from my recent invited talk @SpotifyResearch reflecting on benchmark development, community building, and robust scientific progress based on my experience working on @MSMarcoAI and TREC Deep Learning Track.
https://t.co/3yejkdym4y

Thank you @CharlotteHase for hosting me!

[Bhaskar Mitra | ভাস্কর মিত্র @UnderdogGeek]

TREC 2022 Deep Learning Track test queries (+ top-100 candidates for reranking subtask) has been released.📣 #TREC2022DL #TREC2022

Run submission deadline: *Aug 10*
More info: https://t.co/pyRUKYs87k

Please RT.

[Nick Craswell @nick_craswell]

Announcing: Test queries for the TREC 2022 Deep Learning Track are now available, along with (optional) top-100 candidates for both document and passage ranking. #TRECDL #TREC2022DL
@MSMarcoAI https://t.co/ChL846IujZ

[Bhaskar Mitra | ভাস্কর মিত্র @UnderdogGeek]

📣TREC 2022 Deep Learning Track submission guidelines are out: https://t.co/rzsEcTMvi6
Submission deadline: Aug 10

This will be the second year using the V2 collection. Test queries are coming soon!

#TREC #TREC2022 #TREC2022DL #MSMARCO #DeepLearning