What kind of review is that for a benchmark paper, they want to know if your one benchmark can wrap up the evaluation problem for the field, single-handedly cover every task type that exists in the space, and if it can't, that's treated as a flaw serious enough to reject over?😅
Introducing ><former
Most transformers are rectangles◻️: every layer has the same width
But is that optimal?🤔
We propose variable-width transformers that have different widths across layers, improving loss while cutting compute & KV cache size 🧵
Seeing👀 is not reasoning🤔?
Introducing our new blog post. We tested 8 open VLMs on 9 VQA benchmarks, and found that a lot of "visual" accuracy isn't visual at all. Many benchmarks can be solved without ever looking at the image, and some VLMs reason better from text than from pixels.
[1/n]
New paper: Convergent Evolution: How Different Language Models Learn Similar Number Representations.
Language models, classical word embeddings, and even raw token frequencies all develop the same Fourier features for numbers. But only some develop the underlying structure. 🧵
Excited to share our new work from Meta MSL 🔥
LLMs write great Python/C++ but struggle with uncommon languages. Data scarcity is the bottleneck ⌛ Can we leverage cross-PL transfer to overcome this? Yes ✅
A new method to unlock cross-PL transfer 🧵 https://t.co/8EK05gMgCl
I might be the last one to the show#NeurIPS2025 Finally almost done with TA duties, heading to San Diego right now. DM is open! Happy to chat about multilingual NLP/retrieval/reasoning/multimodal/any random stuff, or to grab boba and coffee! 🫡
What happens when an LLM is asked to use information that contradicts its knowledge? We explore knowledge conflict in a new preprint📑
TLDR: Performance drops, and this could affect the overall performance of LLMs in model-based evaluation.📑🧵⬇️ 1/8
#NLProc#LLM#AIResearch