Mihai Surdeanu

working on #nlproc at University of Arizona

[Reza (Rey) Sanayei @r_sanayei]

📄 Paper: https://t.co/EkcpwoAAQx
🧑‍💻 Code: https://t.co/xRaTZgDTXO

Grateful for the collaboration this summer at @ScaleAILabs with @RazvanDuu @mhrezaeics @Haaris_Riaz @robert_nlp @Yminglai @liuying04 @msurd @danielyuez

[Xinyu Guo @XiY246]

Our paper accepted at EMNLP 2026 main conference! 🎉 @emnlpmeeting
"The Answer Lies Within: Self-Derived Rewards Enable Explainable Relation Extraction"
👉 https://t.co/umTQttBB8j
🌟 Highlight: an efficient, self-derived reward that supervises RE reasoning content, no LLM-as-a-judge needed!
📌 We propose (1) CogRE, a cognitively-inspired reasoning framework; and (2) Hit@Dict, a reward built from the model's own correct explanations
✨Thanks @msurd for the guidance and support!

[Mihai Surdeanu @msurd]

The Department of Computer Science at the University of Arizona (@uarizona) has 2 open faculty positions: One in all areas & all ranks, and one Associate/Full professor working in AI who will also serve as Director of UA’s Cognitive Science program. See https://t.co/3jkPKSDuBk.

[Mihai Surdeanu @msurd]

A great essay about the issues with using gen AI in education: https://t.co/M90XhyXRTt

[Haris Riaz @Haaris_Riaz]

TL;DR Our results indicate that the age of (text-only) pre-training may not be over. Raw text holds more signal than tokens alone — syntax trees are just one structure we can model explicitly.

Work done w/ Hyungji Kim & @msurd.

End🧵.

Blogpost: https://t.co/SzukI3g9Ef
Paper: https://t.co/mMbGmPPYbq

[Haris Riaz @Haaris_Riaz]

Positional embeddings discard syntax, keeping only order & distance. We show that syntax can be reintroduced by adding two lightweight tag embeddings, looked up from small tables, into the model's input embedding, resulting in improved fundamental language modeling. Delighted that our paper on Syntax-informed Positional Embeddings (SiPE) was accepted to EMNLP 2026 main conference! 🥂 w/ Hyungji Kim & @msurd
#EMNLP2026 #InductiveBias #PreTraining

[Ellen Riloff @EllenRiloff]

The Computer Science Department at U.Arizona is looking to hire multiple tenure-track and multiple teaching faculty this year. If you are searching for a faculty position and like sunshine, consider applying! ☀️🌵 https://t.co/wWNGbY7ZZx

[Mihai Surdeanu @msurd]

Just an average sunset in Tucson AZ:

[Mihai Surdeanu @msurd]

"dorction" - a new and important word invented by ChatGPT:

[Razvan Dumitru @RazvanDuu]

Co-authors: @Yminglai @Vikas_NLP_UA @msurd — thank you! See you in Suzhou, Nov 4–9. 🙏 #EMNLP2025 (6/6)

[Dan Jurafsky @jurafsky]

Now that school is starting for lots of folks, it's time for a new release of Speech and Language Processing! Jim and I added all sorts of material for the August 2025 release! With slides to match! Check it out here: https://t.co/pjfZsYxSk0

[Mihai Surdeanu @msurd]

An important new EMNLP paper coming from our lab, with several nice and cool co-authors :)

[Minglai Yang @Yminglai]

Our paper accepted at EMNLP 2025 Main! 🎉 @emnlpmeeting

“How Is LLM Reasoning Distracted by Irrelevant Context? An Analysis Using a Controlled Benchmark”
👉 https://t.co/D9palKsdtr

📌 We introduce GSM-DC: a controlled benchmark for reasoning under Irrelevant Context (IC).
We systematically vary reasoning depth and IC level via a knowledge DAG to study LLM reasoning behavior under distractions, not just accuracy🧭

👥 Huge thanks to my awesome team:
@_ethan_huang @LiangZhang4825 @msurd @WilliamWangNLP @PanLiangming

[Matt Pocock @mattpocockuk]

This is actually a really solid context engineering template.

Kudos, @AnthropicAI

[Mihai Surdeanu @msurd]

This is a good idea: https://t.co/H4L4HwhMRS

[Hadi Amiri @amirieb]

Today (4/25, 11am EST)! In our final CS Colloquium of this series, @msurd shares how combining symbolic rules with neural models leads to more explainable information extraction. #NLP #ExplainableAI @KCSciences_UML @uarizona
see details👉 https://t.co/oBxm1HYaq5

[Mihai Surdeanu @msurd]

I am truly humbled to receive this award. It represents everything I stand for. I consider it the apex of my career.

[Alisa Liu @alisawuffles]

We created SuperBPE🚀, a *superword* tokenizer that includes tokens spanning multiple words.

When pretraining at 8B scale, SuperBPE models consistently outperform the BPE baseline on 30 downstream tasks (+8% MMLU), while also being 27% more efficient at inference time.🧵

[Mihai Surdeanu @msurd]

Our new paper in Findings of NAACL 2025, with Vlad Negru, @robert_nlp, @CameliaLemnaru, and Rodica Potolea, proposes a new, softer take on Natural Logic, where alignment is generated through text morphing. This yields robust performance cross domain. https://t.co/jqiqSl5ZwF

[Andrew Ng @AndrewYNg]

Using AI-assisted coding to build software prototypes is an important way to quickly explore many ideas and invent new things. In this and future posts, I’d like to share with you some best practices for prototyping simple web apps. This post will focus on one idea: being opinionated about the software stack.

The software stack I personally use changes every few weeks. There are many good alternatives to these choices, and if you pick a preferred software stack and become familiar with its components, you’ll be able to develop more quickly. But as an illustration, here’s my current default:
- Python with FastAPI for building web-hosted APIs: I develop primarily in Python, so that’s a natural choice for me. If you’re a JavaScript/TypeScript developer, you’ll likely make a different choice. I’ve found FastAPI really easy to use and scalable for deploying web services (APIs) hosted in Python.
- Uvicorn to run the backend application server (to execute code and serve web pages) for local testing on my laptop.
- If deploying on the cloud, then either Heroku for small apps or AWS Elastic Beanstalk for larger ones (disclosure: I serve on Amazon’s board of directors): There are many services for deploying jobs, including HuggingFace Spaces, Railway, Google’s Firebase, Vercel, and others. Many of these work fine, and becoming familiar with just 1 or 2 will simplify your development process.
- MongoDB for NoSQL database: While traditional SQL databases are amazing feats of engineering that result in highly efficient and reliable data storage, the need to define the database structure (or schema) slows down prototyping. If you really need speed and ease of implementation, then dumping most of your data into a NoSQL (unstructured or semi-structured) database such as MongoDB lets you write code quickly and sort out later exactly what you want to do with the data. This is sometimes called schema-on-write, as opposed to schema-on-read. Mind you, if an application goes to scaled production, there are many use cases where a more structured SQL database is significantly more reliable and scalable.
- OpenAI’s o1 and Anthropic’s Claude 3.5 Sonnet for coding assistance, often by prompting directly (when operating at the conceptual/design level). Also occasionally Cursor (when operating at the code level). I hope never to have to code again without AI assistance! Claude 3.5 Sonnet is widely regarded as one of the best coding models. And o1 is incredible at planning and building more complex software modules, but you do have to learn to prompt it differently.

On top of all this, of course, I use many AI tools to manage agentic workflows, data ingestion, retrieval augmented generation, and so on. https://t.co/zpIxRSuky4 and our wonderful partners offer courses on many of these tools.

My personal software stack continues to evolve regularly. Components enter or fall out of my default stack every few weeks as I learn new ways to do things. So please don’t feel obliged to use the components I do, but perhaps some of them can be a helpful starting point if you are still deciding what to use. Interestingly, I have found most LLMs not very good at recommending a software stack. I suspect their training sets include too much “hype” on specific choices, so I don’t fully trust them to tell me what to use. And if you can be opinionated and give your LLM directions on the software stack you want it to build on, I think you’ll get better results.

A lot of the software stack is still maturing, and I think many of these components will continue to improve. With my stack, I regularly build prototypes in hours that, without AI assistance, would have taken me days or longer. I hope you, too, will have fun building many prototypes!

[Original text: https://t.co/cfQkXolEJk ]

[Firoj Alam @firojalam04]

🚀 Registration for CLEF 2025 Labs is NOW OPEN! Don’t miss your chance to participate in this year’s CheckThat! Lab, where we tackle some of the most critical challenges in fact-checking and information verification.
🔥 Why Join CheckThat! Lab?
This year, we bring you four cutting-edge tasks designed to advance the boundaries of Natural Language Processing and Multilingual Fact-Checking:
🔍 Task 1: Subjectivity
Detect subjective text and pave the way for a refined fact-checking pipeline.
🌍 Languages: Arabic, English, Bulgarian, German, Italian, and Multilingual
✏️ Task 2: Claims Extraction & Normalization
Simplify and normalize social media claims across 20 languages!
🌍 Languages Include: English, Arabic, Hindi, Spanish, Thai, and more
📊 Task 3: Fact-Checking Numerical Claims
Verify numerical claims.
🌍 Languages: Arabic, English, Spanish
🔬 Task 4: Scientific Web Discourse
Classify online scientific discourse and retrive the mentioned paper from a pool of candidate papers
🌍 Language: English
🎓 Who Should Join?
Researchers, students, and professionals in NLP, AI, and fact-checking eager to make an impact.
👉 Register Now: https://t.co/B99pcsvhuP
👉 Learn More: https://t.co/Y9cjAEEOR9
👉 Access Data & Code: https://t.co/JdyN8RaMPK
🗓️ Key Dates to Remember:
November 2024: Registration opens
December 2024: Training materials released
April–May 2025: Evaluation cycle