New work from our lab, accepted @iclr_conf : "The Expressive Limits of Diagonal SSMs for State-Tracking"
We give a complete characterization of what diagonal SSMs can and cannot compute on state-tracking tasks and the answer is deeply connected to group theory.
🧵👇
New work from our lab, accepted @iclr_conf : "The Expressive Limits of Diagonal SSMs for State-Tracking"
We give a complete characterization of what diagonal SSMs can and cannot compute on state-tracking tasks and the answer is deeply connected to group theory.
🧵👇
Can LLMs play Hangman? Spoiler alert: Not yet.
Check out “LLMs Can’t Play Hangman: On the Necessity of a Private Working Memory for Language Agents”, led by @DavideBald42296.