Rotem Dror

Asst. Prof. of Natural Language Processing @UofHaifa

[eaclmeeting @eaclmeeting]

Attention #NLProc researchers, the EACL 2027 website is officially LIVE: https://t.co/0Q0WZVqWV6! 🎉
🇬🇷 Join us in Athens, Greece (Mar 9-13, 2027) at #EACL2027
📅 ARR submission deadline: Aug 6, 2026. Open to all areas of CL/NLP + related fields. Stay tuned for the detailed CfP!

[Rotem Dror @DrorRotem]

@nlopitz lol😅 maybe...maybe not

[Rotem Dror @DrorRotem]

🚨 New Paper(s) Alert 🚨
I’m excited to share papers I’ve recently published, exploring a different application of LLMs:
https://t.co/qUwsuSGgry
https://t.co/e3ybk50hvC
https://t.co/IUtG2xfVPO
https://t.co/XX1Dki2SDk

(Sorry for the paper drop — I’ve been offline for a while.)

[Rotem Dror @DrorRotem]

All very different, but the common theme is: using LLMs in structured, evaluable, and purpose-driven ways.

[Rotem Dror @DrorRotem]

• Adaptive surveys + LLMs for measuring extreme psychological constructs
• Planning-based view + evaluation of LLM web agents
• BET: detecting behavioral & emotional themes in narratives
• Lilo: multi-agent system for children’s digital communication

[Nitay Calderon @NitCal]

[1/7] Why do frontier LLMs make factual errors?
Is it because they never learned the fact…
or because they can’t access knowledge they already encoded?

In our new paper, we show:
The bottleneck is not encoding; it is recall. 🧵👇

Paper: https://t.co/mkkqr0KN4X

Many thanks to @_galyo @bd_eyal @zorikgekhman @eran_ofek59358 @GoogleResearch

[Yanai Elazar @yanaiela]

A strange trend I've noticed at #ACL2025 is that people are hesitant to reach out to papers/"academic products" authors.
This is unfortunate for both parties! A simple email can save a lot of time to the sender, but is also one of my favorite kind of email as the receiver!

[Rotem Dror @DrorRotem]

Tomorrow morning (9AM🌅) I'll be giving a keynote talk at LAW (linguistic annotation workshop) at #ACL2025 on annotations in the era of LLMs - see you there!!🌟🌟

[Nitay Calderon @NitCal]

The Alternative Annotator Test (alt-test) is a new statistical procedure proposed in our ACL 2025 paper! 🇦🇹🇦🇹 @DrorRotem @roireichart

The goal? To help justify using LLMs over humans. If the LLM passes the test, its annotations can be trusted 😎
https://t.co/Y2l8Eyv2mY

[Nitay Calderon @NitCal]

Everyone uses LLMs to annotate data or evaluate models in their research.

But how can we convince others (readers, collaborators, reviewers!!!) that LLMs are reliable? 🤖

Here’s a simple (and low-effort) solution: show the LLM is a *comparable alternative annotator* ✅

[Mike Erlihson, Math PhD, AI @MikeE_3_14]

🔥הסקירות ממשיכות לזרום ל-X🔥
🧵
המאמר היומי של מייק: 25.06.25
The Alternative Annotator Test for LLM-as-a-Judge: How to Statistically Justify Replacing Human Annotators with LLMs

מאמר 🇮🇱

תפנית מעניינת מתרחשת בתקופה האחרונה בעולם של הערכת ביצועי מודלים. אנחנו כבר לא שואלים רק עד כמה המודל מצליח במבחן כלשהו, אלא שאלה מהותית יותר: האם ניתן לסמוך על מודל שפה שיחליף מתייג אנושי? זו לא שאלה שמדדים מסורתיים כמו דיוק, F1 או הסכמה בין מתייגים יכולים לענות עליה כראוי. תחת זאת, המאמר שנסקור היום מציג שיטה מבוססת סטטיסטיקה לפתרון ביעה זו. בלב המאמר עומדת קריאה להתרחק ממדדי התאמה שטחיים, ולעבור לנימוקים מבוססי השערות סטטיסטיות וניתוח עלות-תועלת.

[Nitay Calderon @NitCal]

Preferences drive modern LLM research and development: from model alignment to evaluation.
But how well do we understand them?

Excited to share our new preprint:
Multi-domain Explainability of Preferences
https://t.co/XuoN5Mz246

@roireichart @LiatEinDor
🧵👇
1/11

[Rotem Dror @DrorRotem]

This is your chance to uncover revolutionary research, forge invaluable connections, and become part of the AI innovation wave.
Conference dates: May 25-27, 2025 📷 Information and registration: https://t.co/rqgcPoUpzK

[Rotem Dror @DrorRotem]

Join us at the University of Haifa for the HiAI Conference, a dynamic event at the forefront of Artificial Intelligence.
Immerse yourself in groundbreaking discoveries, gain exclusive insights into the latest advancements, and navigate the future of AI with leading experts.

[Rotem Dror @DrorRotem]

Keynote speakers:
. Hod Lipson, Mechanical Engineering, Columbia University, USA
Prof. Mor Naaman, Information, Cornell Tech, USA
Prof. Tanya Berger-Wolf, Computer Science & Engineering, Ohio State University, USA

[Rotem Dror @DrorRotem]

@VeredShwartz AI is also old...now it's agents😆

[Rotem Dror @DrorRotem]

@jkkummerfeld @VeredShwartz @LChoshen @GabiStanovsky what load is that? Review load or AC load? or to be more clear - if I'm an AC and I submitted a paper, am I expected to be the AC of at least 4 papers, or, in addition to the AC load, also review 4 papers?

[Rotem Dror @DrorRotem]

@VeredShwartz That's amazing Vered! Congrats! 👏 🎉