Markus Dreyer

Principal scientist at Amazon. #NLProc #AI #ML

[Anthropic @AnthropicAI]

Apple's Xcode now has direct integration with the Claude Agent SDK, giving developers the full functionality of Claude Code for building on Apple platforms, from iPhone to Mac to Apple Vision Pro.

Read more: https://t.co/fyZ10bhkN3

[Markus Dreyer @markusdr]

@MinaLee__ @kchonyc Translation please!

[Markus Dreyer @markusdr]

@max_glockner @xiangjiangx @leonardoribeiro @IGurevych 👥 Work by:
@max_glockner @xiangjiangx @leonardoribeiro @IGurevych @markusdr

📄 Paper: https://t.co/qDH4M1UGXE (#ACL2025 Findings)

🗂️ Data: https://t.co/KeNohhWCtU

💻 Code: https://t.co/ysWksOJqlq

@AmazonScience @aclmeeting

[Markus Dreyer @markusdr]

🌟Paper accepted! NeoQA: A benchmark for evidence-based question answering with generated news events. Unlike traditional datasets, NeoQA constructs fictional timelines, ensuring LLMs must reason exclusively over retrieved evidence. 🔍
📃 https://t.co/qDH4M1UGXE
#ACL2025 #NLProc

[Markus Dreyer @markusdr]

@max_glockner @xiangjiangx @leonardoribeiro @IGurevych 📊 Our experiments with multiple LLMs show significant gaps in evidence-based reasoning. 🚧 NeoQA exposes limitations in multi-hop reasoning and shortcut reliance—crucial insights for building trustworthy AI. 🛡️

[Markus Dreyer @markusdr]

@yoavgo Because some jurisdictions ban face recognition.

[Markus Dreyer @markusdr]

Check out our #ACL2024 paper on multimodal summarization! w/ @vaidehi_patil_ @mohitban47 @leonardoribeiro

[Vaidehi Patil @vaidehi_patil_]

🚨In the age of information overload, summarizing key info from diverse modalities such as text and images is crucial. But how to do this effectively? Our #ACL2024 paper introduces a self-refinement approach for improving multimodal LLM summaries and REFINESumm, a new dataset 🧵

[Markus Dreyer @markusdr]

Don't miss the CCSum presentation at #NAACL2024. We present a large-scale dataset (1.3M) for abstractive news summarization. More factual and informative than summaries in CNN/DM, XSum & Multi-News! Joint work w/ Xiang Jiang
💻 https://t.co/lV34GnxB9d
📃 https://t.co/DUeXWnQiXm

[Markus Dreyer @markusdr]

@bdunwood @ka86 @TomPenny @Sonos Same here. This update is a huge disappointment without alarms.

[Dipanjan Das @dipanjand]

Happy new year! Just a reminder to everyone who works on language modeling that COLM is a new conference that I am co-organizing with several esteemed colleagues from academia and industry. Abstract deadline is on March 22 followed by the paper deadline on March 29.

https://t.co/Fahzql7MfF

[NeurIPS Conference @NeurIPSConf]

We are excited to announce the #NeurIPS2023 paper awards:
https://t.co/co9yGJT7xL

[Ashish Vaswani @ashVaswani]

I'm thrilled to announce our company, @essential_ai . We believe that breakthroughs in AI will unlock the most profound tools for thought, advancing humanity's collective knowledge and capability.

https://t.co/unA2spJDDR

[Markus Dreyer @markusdr]

Exciting work w/ @AdithyaPratapa and @smallcadenza! ✨We generate background summaries for events based on news timelines. https://t.co/gIHCcICX8f Outstanding paper award at #EMNLP2023 summarization track.🤩Check out our dataset for this task: https://t.co/pwzNdxvEtG #NLProc

[Adithya Pratapa @AdithyaPratapa]

Delighted to share that our @emnlpmeeting work on background summarization received an outstanding paper award in the summarization track 🏆

w/ Kevin Small and @markusdr

Paper: https://t.co/57LDXHMgDn
Github: https://t.co/kRz7JSlnsw

Highlights below, (1/4) #EMNLP2023

[Markus Dreyer @markusdr]

#EMNLP2023 is coming up. Don't miss our paper on controllable text generation! https://t.co/RPXmfAzFO0

We control text readability using RL/PPO with Gaussian rewards, look-ahead decoding, and prompt instructions.

#NLProc @mohitban47 @leonardoribeiro

[Leonardo F. R. Ribeiro @leonardoribeiro]

🚨How to generate summaries w/ fine-grained readability-level control?

In our new #EMNLP2023 main paper, we develop 3 readability-control methods via instruction-prompting, RL, & lookahead decoding.

​​https://t.co/O63y3uqnf4

@mohitban47 @markusdr @AmazonScience @uncnlp

🧵👇

[eaclmeeting @eaclmeeting]

Looking for something to read? The proceedings of #EACL2023 can be found on the @aclanthology !

https://t.co/1ZYY0KQYym

#NLProc #eacl #ACLAnthology

[Markus Dreyer @markusdr]

In our paper, we propose metrics that combine abstractiveness and factuality. The metrics adjust for different levels of abstractiveness when comparing the factuality of different text generation systems. https://t.co/9JZVmH28uE

[Markus Dreyer @markusdr]

Check out our paper "Evaluating the Tradeoff Between Abstractiveness and Factuality in Abstractive Summarization" at #EACL2023 Findings! #NLProc

https://t.co/9JZVmH28uE

Dataset release: 14k human factuality judgements!

cc: @ravisujith, @AmazonScience

🧵👇 1/n

[Markus Dreyer @markusdr]

The tradeoff between abstractiveness and factuality is similar to the tradeoff between precision and recall. High precision can be trivially achieved with low recall, just as high factuality can be achieved with low abstractiveness. #NLProc