Craig Thomson

Research Fellow at Dublin City University.

[Craig Thomson @ThomsonSoftware]

Welcome everyone to #HumEval2024 The first session has started and our schedule can be found here. https://t.co/PekdK1ueak

[Craig Thomson @ThomsonSoftware]

Dear @SkyUK, I am a little worried about your staff. This Virtual Assistant seems to be quite possessive. Can you please confirm that your premises have not been taken over by an unruly AI.

[Anya Belz @anyabelz]

@HuidromRudali @ThomsonSoftware @simon_mille Next in the @DCU-NLG group #INLG2004 line up: our amazing @HuidromRudali kicks off the first oral session of the main @inlgmeeting conference presentating her work on Differences in Semantic Errors Made by Different Types of Data-to-text Systems😍 https://t.co/MY1gYUWVty

[Anya Belz @anyabelz]

Come join us for the #INLG2024 Tutorial on Human Evaluation of #NLProc System Quality on 24 Sep in Tokyo🗼🇯🇵!! Programme and summary paper available👇@JoaoSedoc @HuidromRudali @ThomsonSoftware @simon_mille @AdaptCentre @dcucomputing @inlgmeeting https://t.co/bZTEFzFVsr

[Anya Belz @anyabelz]

Very pleased to say we're running a Tutorial on Human Evaluation of #NLProc System Quality at #INLG2024 @inlgmeeting in September in Tokyo!! With @simon_mille @ThomsonSoftware @JoaoSedoc @HuidromRudali #DCUNLP 1/2

[INLG 2026 @inlgmeeting]

Good news everybody! You have an extra 7 days to prepare you submissions for #INLG2024! Please let everyone you know know!

The new deadline for Friday, 7th of June 11:59 PM AOE!

https://t.co/P3qeZoTmEn

[Craig Thomson @ThomsonSoftware]

All of the papers from #HumEval2024 will appear in the ACL Anthology https://t.co/LmLyOSYZbF

[Craig Thomson @ThomsonSoftware]

Welcome everyone to #HumEval2024 The first session has started and our schedule can be found here. https://t.co/PekdK1ueak

[Craig Thomson @ThomsonSoftware]

We now have Mohamed Elaraby presenting their work on "Adding Argumentation into Human Evaluation of Long Document Abstractive Summarization: A Case Study on Legal Opinions". #HumEval2024.

[Craig Thomson @ThomsonSoftware]

Another poster from our ReproHum partners at Heriot-Watt. Many of these posters, including this one, are work towards the multi-lab multi-test study of the ReproHum project. https://t.co/0F7lIIgQFX

[Craig Thomson @ThomsonSoftware]

Great poster session at #HumEval24 for #ReproNLP2024, here are the posters and paper titles; papers should be on ACL Anthology shortly.

[Craig Thomson @ThomsonSoftware]

Really good poster presentation by @PSchmidtova and @LangoMateusz on their #HumEval2024 paper "ReproHum #0043-4: Evaluating Summarization Models: investigating the impact of education and language proficiency on reproducibility"

[Craig Thomson @ThomsonSoftware]

Great poster presentation by @j_corbelle on their poster "ReproHum #0927-3: Reproducing The Human Evaluation Of The DExperts Controlled Text Generation Method"

[Craig Thomson @ThomsonSoftware]

Really good poster presentation by @anouckbragg. Poster title: "ReproHum: #0033-03: How Reproducible Are Fluency Ratings of Generated Text? A Reproduction of August"

[Craig Thomson @ThomsonSoftware]

Excellent poster presentation by Toky Raboanary on their reproduction work with @nqongeveg and Maria Keet. Poster is "ReproHum #0866-04: Another Evaluation of Readers' Reactions to News Headlines"

[Craig Thomson @ThomsonSoftware]

Great poster presentation by Andra-Maria Florescu and Marius Micluta-Campeanu for #HumEval2024. "Once Upon a Replication: It is Humans' Turn to Evaluate AI's Understanding of Children's Stories for QA Generation".

[Craig Thomson @ThomsonSoftware]

Great poster by @MichelaLorandi at #HumEval2024. "Reproducing the Metric-Based Evaluation of a Set of Controllable Text Generation Techniques"

[Craig Thomson @ThomsonSoftware]

"ReproHum #1018-09: Reproducing Human Evaluations of Redundancy Errors in Data-To-Text Systems", Great poster by Filip Klubička @lemoncloack.

[Craig Thomson @ThomsonSoftware]

"Exploring Reproducibility of Human-Labelled Data for Code-Mixed Sentiment Analysis". Great virtual presentation by @heysachins. An interesting reproduction of both a training corpus and the classifiers which are then trained on it.

[Craig Thomson @ThomsonSoftware]

Very pleased to have as our second invite talk, Ding Wang from Google Research. The talk is on "All That Agrees Is Not Gold: Evaluating Ground Truth and Conversational Safety". #HumEval2024

[Craig Thomson @ThomsonSoftware]

@anyabelz is now presenting the results of the ReproNLP challenge https://t.co/9OCbso3Enj #HumEval

[Craig Thomson @ThomsonSoftware]

We now have Toky Hajatiana Raboanary presenting their reproduction of https://t.co/99yGjRV6OC #HumEval2024