@DakingRai is one of my best. Highly recommend for any team recruiting for LLM Interp/reasoning/controllability/etc. He plans to graduate in a year or so. Go meet him at the poster session or msg him for a chat directly!
Exhibit Hall C,D,E #3815
Thu 4 Dec 4:30 p.m. PST — 7:30 p.m. PST
(1/3) Started this as a side project on a whim and had fun presenting it at the COLM 2025 XLLM-Reason-Plan Workshop recently. @XllmReasonPlan
Built a small dataset of rebus puzzles to see how VLMs reason through visual wordplay.
Dataset: https://t.co/EIWBHZfIWz
We are very honored to receive the Best Paper Award! Reviewers’s comments are very insightful! We really appreciate such valuable recognition from the workshop committee!
Honorable Mentions go to:
Li et al., "Rethinking Human Preference Evaluation of LLM Rationales", and
Rai et al., "Failure by Interference: Language Models Make Balanced Parentheses Errors When Faulty Mechanisms Overshadow Sound Ones" @DakingRai
#COLM2025 Finally, the awards!🏆 We announced one Best Paper Award, one Special Recognition Award, and two Honorable Mentions. Congrats to the authors! See 🧵👇
Special Recognition Award goes to Shi et al., "When Models Know More Than They Can Explain: Quantifying
Knowledge Transfer in Human-AI Collaboration" @BenShi34
Best Paper Award goes to Li et al., "Attributing Response to Context: A Jensen-Shannon Divergence Driven Mechanistic Study of Context Attribution in Retrieval-Augmented Generation" @liruizhe94
@COLM_conf#COLM2025 Our last invited talk if you are still around: Prof. Zining Zhu is presenting "Improving LLM reasoning with mechanistic insights" @zhuzining