Eval4NLP

Workshop on Evaluation and Comparison of NLP Systems, co-located with #AACL2025.

[Eval4NLP @eval4nlp]

📢📢 This year Eval4NLP is co-located with #aacl2025. Our CFP is now out: https://t.co/vHEQblCOW9

Paper submission deadline: September 29, 2025. Direct submission via OpenReview.
ARR commitment deadline: October 27, 2025
Notification of acceptance: November 3, 2025

[NLLG @NLLG_lab]

Two more days left to apply 👇👇

https://t.co/oXbzedLNqH

[NLLG @NLLG_lab]

📢📢📢The NLLG lab has three new open fully funded PhD positions:
1⃣ - Next Generation LLMs
2⃣ - NLP for Science
3⃣ - Multimodal evaluation metrics

Deadlines: End of October

ℹ️More information: https://t.co/4YaV6tKANE

[NLLG @NLLG_lab]

📢📢👉👉@chrleiter presenting his work on how explainability can improve evaluation metrics for MT and summarization tomorrow at #eacl2024

https://t.co/GG2bNIgOye

[Eval4NLP @eval4nlp]

Eval4NLP23 has concluded. We thank everyone + congratulate our shared task winners on inducing high-quality metrics for MT+summ. using prompting and efficient models: "HIT-MI&T Lab" (even beating GEMBA + COMET🚀) & "DSBA".

Shared task overview paper: https://t.co/fqFDuPOsg4

[Eval4NLP @eval4nlp]

Our accepted papers and program are now online:
https://t.co/520Osga1lW
https://t.co/mwTsmnCR8m

Moreover, we're excited to have @alexfabbri4 as invited speaker on the topic of "Re-Evaluating Summarization Evaluation in the Era of LLMs"

See u tomorrow 9am (UTC+8), online only!

[Eval4NLP @eval4nlp]

📢📢To accommodate the recent ARR author response period, Eval4NLP @aaclmeeting extends the deadline for pre-reviewed papers until September 30th.

Pre-reviewed papers must include: the paper along with its original reviews and scores.

More details: https://t.co/aiqLMELSZG

[will depue @willdepue]

Round #2 of DALLE images, using requests from y'all.
Here's two animals mixed together into a new species.

[Eval4NLP @eval4nlp]

📢📢 Don't forget: Pre-reviewed papers can be submitted to Eval4NLP @aaclmeeting until September 25 via Openreview

Just include the paper and your meta-reviews along with reviews and all the scores.

https://t.co/aiqLMELSZG

[Eval4NLP @eval4nlp]

@_danieldeutsch Interesting work! Just pointing out: DiscoScore might be (considerably) stronger than Blonde as a doc-level metric. https://t.co/9lef2Epctu

[Eval4NLP @eval4nlp]

@gg42554 @ReviewAcl The reviewing quality is bad in NLP, agreed. But it's also often because there are so many junior people (who sometimes need to step in because there aren't enough reviewers). Exposing them publicly may also be problematic for various reasons.

[Eval4NLP @eval4nlp]

Due to popular demand, the Eval4NLP workshop @ @aaclmeeting submission deadline has been moved to September 1. We look forward to your submissions! 📣📣

More infos: https://t.co/aiqLMELSZG

[Eval4NLP @eval4nlp]

📢📢Brief reminder that Eval4NLP submission deadline is this **Friday, 25.08.2023**

Focus: Evaluation with/of LLMs, all other evaluation aspects also very welcome

2nd call4papers: https://t.co/UELSVSPtDW

Webpage: https://t.co/U6oTingFlR

Venue: @aaclmeeting (Bali 🏖️)

[juri @nlopitz]

Shared task on explainable evaluation metrics: The development phase is running, but participation is still easily possible, there's also no necessity to train systems to take part. #nlproc #machinelearning

Find out more @nlp_evaluation:

https://t.co/pKEYHZAZXp

[Eval4NLP @eval4nlp]

@markuseful AutoMQM would be a great candidate for the Eval4NLP shared task on explainaple metrics :) https://t.co/D4SOZGhrof

[Eval4NLP @eval4nlp]

📢📢📢 We have released the description of Eval4NLP's shared task on "Prompting LLMs as Explainable Evaluation Metrics" (for MT & summarization).

Dev phase: Aug. 7
Test phase: Sep. 18
System Submission Deadline: Sep. 23

More details: https://t.co/D4SOZGhZdN

🚀🚀🚀

[Eval4NLP @eval4nlp]

📢📢📢 The Eval4NLP workshop will take place this year at AACL 2023. Special focus: Evaluation of/with LLMs. Including a shared task on Prompting LLMs as Explainable Metrics. 📢📢📢

Direct submission deadline: 25.08.
Webpage: https://t.co/U6oTing7wj
CFP: https://t.co/YX44521zr2

[Eval4NLP @eval4nlp]

Eval4NLP is happening tomorrow, starting at 10:30 UTC. Our combined program with @sum_eval includes some great paper presentations and invited talks from @peyrardmax and @rktamplayo. See you there tomorrow!

https://t.co/oU9wG4wTxZ

[Eval4NLP @eval4nlp]

The list of accepted papers is now on our website! https://t.co/h99q4kurwt Congratulations to all of the authors, and we look forward to your presentations on November 20.

FYI, registration for AACL is now open! https://t.co/DUoK4UdIFo

[Eval4NLP @eval4nlp]

This year, Eval4NLP is accepting submissions of papers with reviews from other venues (see the CFP for more details https://t.co/QiaPUqfHQW).

Submit your paper and reviews here https://t.co/K17WTVlHVo by September 21, AOE!