#COLM was fun, lot of interesting discussions. Thank you @COLM_conf for the wonderful organisation and snacks. Want to take a break over the weekend, but ARR deadline is around the corner ๐ญ
In SF Oct 5โ12 for @COLM_conf, presenting UNMASK. Keen to hear what everyone's building. Looking forward to connecting with people working on Evals, interpretability and AI safety.
Please check out the paper for more such interesting findings.
Paper - https://t.co/8Y3zsbtelz
Work done at UNC-Chapel Hill under supervision of my advisor @shsriva. The paper is accepted at COLM 2026 - see you in SF this october
Language Models are very good at exploiting shortcuts. Existing approaches either require manual specification of the spurious feature or automate discovery only
partially. The gap between dataset-level correlation and model-level exploitation is unaddressed.
UNMASK closes that
We tried the discovery half at RewardBench2. No debiasing, just which surface predicates separate chosen from rejected and Math's strongest signal is the phrase "let me help you solve this step by step." OR 22.7. This forces to learn string, not a reasoning style.
This is just like a live look at someone's commit history who relies entirely on an LLM with a bloated context window.
- Opus is fixed, but Sonnet broke.
- Sonnet is fixed, Fable is down.
- Screw it, everything is broken, reverting to yesterday's branch and starting a new chat.
What if you could just ask a business question and get predictions from relational data?
Built NL2PQL on @kumoai's RFM - natural language in, predictions + strategy report out. No PQL needed.
Open Source: https://t.co/gjroasTJQF
@BlazStojanovic@Kumo_ai_team@jure@rusty1s
Meta's search for the ultimate unicorn candidates is still on!๐ฆ
They're looking for a Generative AI Software Engineer who is somehow still getting their Bachelor's degree, but also already has a PhD and first-author papers at NeurIPS/ICML.