Generation Evaluation & Metrics Workshop

Official Handle of the 💎 Generation Evaluation & Metrics (GEM) workshop (ACL 2021, EMNLP 2022, EMNLP 2023)

[Generation Evaluation & Metrics Workshop @gem_workshop]

Excited🤩for the 3rd GEM Workshop EMNLP 2023! Here's the schedule for Dec 6! (in Singapore🇸🇬time)

9-10:30 Opening Remarks + 6 12min talks
10:30-11🧋Coffee Break
11-12:30🪧Poster Sess 1
12:30-14🍕Break
14-15:30 7 12min talks
15:30-16🧋Covfefe Break :P
16-17:30🪧Poster Sess 2
👇🏻

[Yufang Hou @yufanghou]

📢Please help us to spread the word: the GEM human evaluation team is launching a new multilingual shared task on data-to-text generation and summarization. More information at https://t.co/yR83JZZNbs. We are looking forward to receiving your submissions!
#NLProc #NLP

[Vered Shwartz @VeredShwartz]

Finally, @ShuhaibMehri will present his work on instruction tuning for automatic evaluation of generative tasks (https://t.co/hgRdZnJus5) at the GEM workshop on Wed, Dec 6 at 11am SGT. He is applying to grad schools, talk to him if you're recruiting :) 7/7

[Tiancheng Hu is looking for a job (industry) @tiancheng_hu]

On my way to @emnlpmeeting soon!

Join me at @gem_workshop in Leo 2, 2:30pm on Dec 6 for a presentation about this paper.

Thrilled to also contribute as a panelist in @WiNLPWorkshop on "Tackling Misinformation in Generative AI", 11:00am-12:00 in Leo 1 on Dec 6. See you there!

[Janet Liu ⛷️ @janetlauyeung]

1⃣ Stop by my poster presentation at the @gem_workshop on Dec 6 at 11:00am-12:30pm if you're interested in evaluating summarization for non-news data and how discourse structures can support applications like summarization across text types

https://t.co/pv767TILtO

[BathNLP @BathNLP]

We have three papers led that will be presented at #EMNLP2023 and #GEMWorkshop centered around readability assessment and language model evaluation ✍️📢

Work done by @josephimperial_ and @harish

See you in Singapore! 🌃🇸🇬

[Generation Evaluation & Metrics Workshop @gem_workshop]

Excited🤩for the 3rd GEM Workshop EMNLP 2023! Here's the schedule for Dec 6! (in Singapore🇸🇬time)

9-10:30 Opening Remarks + 6 12min talks
10:30-11🧋Coffee Break
11-12:30🪧Poster Sess 1
12:30-14🍕Break
14-15:30 7 12min talks
15:30-16🧋Covfefe Break :P
16-17:30🪧Poster Sess 2
👇🏻

[Meriem @mellem_boo]

Excited to present our recent work at the GEM 💎Workshop, EMNLP 2023:
“Elo Uncovered: Robustness and Best Practices in Language Model Evaluation”

w/ @eddotman, @beyzaermis, @sarahookr, @mziizm
📃: https://t.co/xc5RsC2BYm

[Learn Prompting @learnprompting]

At #EMNLP right now?

Check out the GEM💎workshop. A lot of good prompt-based stuff 👇🧵

https://t.co/nTeshZbQv9

[Sebastian Gehrmann @sebgehr]

GEM logistics update: The venue has internet issues and we cannot get a stable zoom connection.

If you are scheduled to give a talk in the early session and have the ability to go this afternoon instead let us know and we will reshuffle things. We are continuing to try to join.

[Yixin Wan @yixin_wan_]

Might be slightly last minute, but I’m thrilled to announce that I will also be giving a talk on our paper in the @gem_workshop this afternoon! 🤩 The session will start at 2pm, in room Leo 2, but it will also be co-hosted through zoom. Drop by and say hi! 😁

[Yuling Gu @gu_yuling]

Check out our poster "Robust Tooling and New Resources for Large Language Model Evaluation via Catwalk" at the @gem_workshop (11am - 12.30pm, Dec 6). Visit my collaborators from @allen_ai there too!

[Nishant Subramani @nsubramani23]

Heading to #EMNLP2023 today! Would love to catch up with old friends and meet new folks excited about interpretability, generation, and understanding LM internals 🔧

📜 - My collaborators at @allen_ai are presenting our poster on LM eval at the @gem_workshop at 11am today!

[Khyathi Chandu @khyathi_chandu]

Today and Now!!! Checkout the fantastic talks and posters lined up at #GEM at #EMNLP2023. If you are interested in generation and evaluating it, come join us in room *Leo* for the exciting schedule today 🤩🤩 #NLProc

[Sebastian Gehrmann @sebgehr]

GEM workshop logistics: we are in LEO 2. Up two escalators and a bit of a walk.

We have a rocket chat channel #gem-workshop we will monitor for questions.

See you soon!

[Generation Evaluation & Metrics Workshop @gem_workshop]

The workshop starts at 9am Singapore time which is
8 pm in New York🇺🇸
6:30 am in Bangalore🇮🇳
1 am in London🇬🇧
9am in Beijing🇨🇳
2am in Lagos🇳🇬

[Generation Evaluation & Metrics Workshop @gem_workshop]

Excited🤩for the 3rd GEM Workshop EMNLP 2023! Here's the schedule for Dec 6! (in Singapore🇸🇬time)

9-10:30 Opening Remarks + 6 12min talks
10:30-11🧋Coffee Break
11-12:30🪧Poster Sess 1
12:30-14🍕Break
14-15:30 7 12min talks
15:30-16🧋Covfefe Break :P
16-17:30🪧Poster Sess 2
👇🏻

[Generation Evaluation & Metrics Workshop @gem_workshop]

Check out the fantastic work done by the presenters here: https://t.co/MzihTBVfV4

💎GEM aims to measure NLG progress across tasks & langs, audit data & models,present results via data cards & robustness reports,develop standards for automatic & human evaluation of generations

[Jekaterina Novikova @J_Novikova_NLP]

Looking forward to the GEM workshop at EMNLP (
@gem_workshop) where 45 papers on evaluation, generation and metrics were accepted this year!
As AC I only saw 6 of them so far, and all the accepted ones presented interesting approaches and valuable contributions - don't miss!