SUMEval @ COLING 2025

2nd Workshop on Scaling Up Multilingual & Multi-Cultural Evaluation @ COLING 2025

[SUMEval @ COLING 2025 @sum_eval]

11 AM GST: Panel Discussion-1: Challenges of Collecting Culturally Grounded Multilingual Data for Training and Evaluation of NLP Systems.

[SUMEval @ COLING 2025 @sum_eval]

SumEval-2 is happening today at ADNEC, Abu Dhabhi. Looking forward to meeting all the participants!

[SUMEval @ COLING 2025 @sum_eval]

**Archival Submission Deadline**
Reminder to submit your archival submissions by Nov 8th, 2024 (AOE)

Submission Link: https://t.co/ohusIJefCS

Please check our website for more details: https://t.co/9e8nqbiBU7 or contact us at [email protected]

[SUMEval @ COLING 2025 @sum_eval]

Softconf Submission Link: https://t.co/ohusIJefCS

Please check our website for more details: https://t.co/mYERsqHoNg
or contact us at [email protected]

[SUMEval @ COLING 2025 @sum_eval]

** Updates **

* We are excited to announce that, there will be cash awards for two best papers, one for archival and one for non-archival track

* We are extending the archival submission deadline to Nov 8, 2024 (no changes to the non-archival submission deadline Nov 25, 2024)

[SUMEval @ COLING 2025 @sum_eval]

Thanks to Microsoft for their generous sponsorship for their cash awards.

[SUMEval @ COLING 2025 @sum_eval]

@nlp_survey Regarding your second question, if you are also submitting to COLING it will not be included in the proceedings, but you can present it during the workshop.

[SUMEval @ COLING 2025 @sum_eval]

***SumEval Archival Submission Deadline***

Archival Submission: October 18th, 2024
Softconf Submission Link: https://t.co/ohusIJefCS

Please check our website for more details: https://t.co/9e8nqbiBU7… or contact us at [email protected]

[SUMEval @ COLING 2025 @sum_eval]

@nlp_survey @nlp_survey the theme of your work could match with several areas that we are targeting within the workshop (i.e. Studies on scaling up multilingual and multicultural evaluation, Data sets, benchmarks, or libraries for evaluating multi-lingual models etc.).

[SUMEval @ COLING 2025 @sum_eval]

with: @monojitchou , @vishrav , Sunayana Sitaram, @seb_ruder , @HellinaNigatu , @OanaIgnatRo

[SUMEval @ COLING 2025 @sum_eval]

@HellinaNigatu @OanaIgnat @seb_ruder @monojitchou @vishrav Please check our website for more details: https://t.co/9e8nqbiBU7 or contact us at [email protected]

[SUMEval @ COLING 2025 @sum_eval]

Announcing the second edition of SUMEval - Workshop on Scaling Up Multilingual and Multi-Cultural Evaluation of foundation models will be held in conjunction with COLING 2025.

with : @HellinaNigatu , @Oanaignat, @seb_ruder, Sunayana Sitaram, @monojitchou, @vishrav

[SUMEval @ COLING 2025 @sum_eval]

@HellinaNigatu @OanaIgnat @seb_ruder @monojitchou @vishrav ***Important Dates***
Archival Submission: October 18th, 2024
Non-archival Submission: November 25th, 2024
Notification of Acceptance: December 3rd, 2024
Camera-Ready Papers Due: December 10th, 2024
Workshop Date: January 20th, 2025, co-located with COLING 2025

[SUMEval @ COLING 2025 @sum_eval]

In addition to regular papers submitted to the workshop, we will also accept papers that were submitted elsewhere and papers with AACL and ARR reviews.

For detailed information regarding submission instructions, please visit https://t.co/FzQOikMNzx

[SUMEval @ COLING 2025 @sum_eval]

** SumEVAL Paper Submission Deadline Extended **

We are extending the SumEVAL workshop paper submission deadline to September 23, 2022.

[SUMEval @ COLING 2025 @sum_eval]

SUMEval workshop paper deadline has been extended to September 1st, 2022

Paper Submission Instructions: https://t.co/P2bZDRja7L

[SUMEval @ COLING 2025 @sum_eval]

Test sets for all the languages (surprise + non-surprise) have now been released.

Submission instructions: https://t.co/rr4ELkLSx9
SUMEval shared task: https://t.co/KFwKttqdyA

August 15 2022: Challenge ends
August 25 2022: Paper submission deadline