๐ฅNew paper accepted to COLM!๐ฅ
How should LLMs reason about moral dilemmas across cultures? We tackle this with three contributions:
1โฃ MCLASH: a culturally-adapted evaluation dataset
2โฃ MET: a theory-grounded reasoning method
3โฃ MET-D: MET + self-distillation
๐ฐ https://t.co/agUxGEDIuJ
๐ค https://t.co/mI7IbdXK35
๐งต๐
๐ขNew benchmark out!
We introduce CLASH, a benchmark of 345๐ฅhigh-stakes dilemmas and 3,795 perspectives to evaluate how well LLMs handle complex value reasoning.
GPT-4 and Claude? Not quite there.
๐ https://t.co/EUkdH577tz
๐คย https://t.co/JlIEucJMM3