Shubhra K. Karmaker ("Santu")

Assistant Professor of Computer Science at Auburn University.
Communication Chair of ACL Rolling Reviews (ARR)

[Adam Bawatneh @abawatneh120]

Theory of Mind 🧠 is a core part of social intelligence.

But most LLM benchmarks only test the final answer, not whether the model actually built the right mental model.

We introduce OmniToM, a benchmark for multi-actor mental state reasoning.
https://t.co/hukaglNg03

[Shubhra K. Karmaker ("Santu") @karmake2]

📷 Match: Argentina vs. Jordan
📷 Date: June 27, 2026
📷 Venue: AT&T Stadium, Arlington, TX
📷 Quantity: 2 Tickets
Price: $1200 per ticket
Section 450: Row 18: Seat 18, 19

If you're interested, please send me a private message for details regarding the seats.

[Shubhra K. Karmaker ("Santu") @karmake2]

📷 FIFA World Cup 2026 Tickets for Sale 📷

I have *2 tickets* available for the *Argentina vs. Jordan* World Cup match at *AT&T Stadium, Arlington, Texas* on *June 27, 2026*.

Price: $1200 per ticket
@FIFAWorldCup @ticket @argentina

[Shubhra K. Karmaker ("Santu") @karmake2]

I will be participating as an AI Expert Panelist at the following webinar tomorrow. The @UCF and the U.S. Army DEVCOM Army Research Laboratory will jointly host the webinar. Please RSVP in case you are interested in the topic. @UCFCECS @usarmy_devcom #AI #HumanAICollaboration

[Shubhra K. Karmaker ("Santu") @karmake2]

@IAmAYadavally @ReviewAcl @USNavyResearch @UCFCECS @UCFComputerSci @UCFIAI Thanks, Aashish!

[Shubhra K. Karmaker ("Santu") @karmake2]

Honored to receive the 2026 Young Investigator Award from the Office of Naval Research. Time for some celebrations! @ReviewAcl @USNavyResearch @UCFCECS @UCFComputerSci @UCFIAI

https://t.co/cjUQ2IoYaw

[Shubhra K. Karmaker ("Santu") @karmake2]

Do you like https://t.co/L8ThvgOKpJ? If yes, how about a similar ranking platform for LLMs? Check out our latest work on the LLM Ranking based on their psychological biases.

https://t.co/tk58kIWv50

@ReviewAcl #LLM #NLP @emnlpmeeting @aclmeeting

[BridgeAI Lab @BridgeAI_Lab]

Do large language models think like humans? Are they also prone to human-like cognitive biases?
We just launched a new ranking system of LLMs based on their ability to resist cognitive biases with a large-scale study of 2.8M+ responses across 8 well-known biases.

[Shubhra K. Karmaker ("Santu") @karmake2]

Job Posting: Postdoc Position Available https://t.co/7gbdK8J6fQ

@ReviewAcl @emnlpmeeting @naaclmeeting @aclmeeting #NLP #postdoc #UCF

[Shubhra K. Karmaker ("Santu") @karmake2]

@ReviewAcl #NLProc #ACL

[BridgeAI Lab @BridgeAI_Lab]

Bridge-AI Lab is looking for a talented Postdoctoral Researcher to advance cutting-edge AI/ML research! If you have a Ph.D. and more than one publication at top AI/ML conferences or journals, we want to hear from you!

(1/3)

[BridgeAI Lab @BridgeAI_Lab]

We are glad to share our latest NAACL 2025 paper, "LLMs as Meta-Reviewers' Assistants: A Case Study".

Read the full paper at: https://t.co/jSdGEgsOFj

(1/2)

[ACLRollingReview @ReviewAcl]

🚨 We are hiring! 🚨
We are looking for two new members to join our communication team and help support the ARR initiative. If you’re interested, please fill out the following form: https://t.co/IAEHYFVf10

[Shubhra K. Karmaker ("Santu") @karmake2]

Our latest paper introduces the pre-evaluation of sentence encoders, similar to pertaining language models!! Pre-evaluation performs evaluation without a specific downstream task, that's why we call it taskless evaluation as well. @ReviewAcl

[BridgeAI Lab @BridgeAI_Lab]

A big thanks to @eduardo_nlp for his collaboration and significant contributions to this work.
Our paper introduces ALIGN-SIM, a novel task-free framework for evaluating and interpreting sentence embeddings based on various semantic similarity alignment criteria.

2/2

[Shubhra K. Karmaker ("Santu") @karmake2]

@Tanmoy_Chak @dirk_hovy @emnlpmeeting @aclmeeting @iitdelhi @lcs2lab @IAugenstein @c_christodoulop @aliceoh @kaiwei_chang Congratulations tanmoy

[ACLRollingReview @ReviewAcl]

🚨 Attention authors! The CFP has been updated for the December cycle. Be sure to double-check the latest requirements: https://t.co/wSE9cYUOdR 📝

We have also updated the author checklist to help you avoid common issues: https://t.co/WNM8aSoDOi

[Shubhra K. Karmaker ("Santu") @karmake2]

Attending EMNLP 2024, Miami.

[Shubhra K. Karmaker ("Santu") @karmake2]

The Bangla LLaMA (BongLLaMA) is here.

[BridgeAI Lab @BridgeAI_Lab]

We are excited to collaborate with BangaLLM to introduce BongLLaMA, the first ever and, of course, the state-of-the-art Bangla LLM (Based on Meta LLaMA). Try it out.
@ReviewAcl #EMNLP #ACL #NLP #BanglaAI
@UCFComputerSci
https://t.co/pspbIHYmAR

[Shubhra K. Karmaker ("Santu") @karmake2]

@ReviewAcl FYI, potential NLP graduate students
#NLP #AI #PhDposition #LLM

[BridgeAI Lab @BridgeAI_Lab]

We are excited to share that Dr. Souvika Sarkar, who recently completed her Ph.D. with Bridge-AI Lab under the supervision of Dr. Shubhra Kanti Karmaker Santu, has joined Wichita State University as a tenure-track faculty member of the School of Computing.

1/3

[Shubhra K. Karmaker ("Santu") @karmake2]

UCF CS has Ph.D. openings for Fall 2025. Consider applying to @UCFComputerSci @ReviewAcl

https://t.co/ntDJUZVbqz

[Shubhra K. Karmaker ("Santu") @karmake2]

Auburn CSSE is a very collegial department. Please consider applying: @AuburnEngineers
https://t.co/PElQ2qqWsu

@ReviewAcl #facultyhiring #AIFaculty #TTFaculty

[Shubhra K. Karmaker ("Santu") @karmake2]

Please try SEM-F1 and let us know if you see a better correlation with human judgments too!

[BridgeAI Lab @BridgeAI_Lab]

We are happy to release our text summarization metric, Sem-F1, for public use. https://t.co/BQ6MYrJ2KY

Sem-F1 achieves a 25% higher correlation with human judgments than Bertscore on the Overlap Summarization task. Benchmarking paper coming soon.
@ReviewAcl