Your VLA heard you, it just doesn't care.
Excited to announce our paper, Not All Features Are Created Equal: A Mechanistic Study of Vision-Language-Action Models, was accepted at NeurIPS 2026 ๐
https://t.co/HA1z9UNcvE
We built Action Atlas to catalog VLAs: search 520+ SAEs by concept, steer a feature on live models, and watch hours of rollouts๐.
https://t.co/b0iy608Jga
Code: https://t.co/2zjIl8SBdN
Come visit in Hall 1-4 on Wed, 12/9 at 5pm AEDT in Sydney Poster Session 4!
#NeurIPS2026
Your VLA heard you, it just doesn't care.
Excited to announce our paper, Not All Features Are Created Equal: A Mechanistic Study of Vision-Language-Action Models, was accepted at NeurIPS 2026 ๐
https://t.co/HA1z9UNcvE
Probes decode the instruction at >99%, but the scene outweighs it. With no prompt at all, ฯ0.5 still solves 31.6% of LIBERO-Object. To see what they use instead, our 520+ sparse autoencoders (SAE) split activations into readable features: 79 motion, object, and spatial concepts.
Presenting two mechanistic interpretability works today at @iclr_conf
Giving a talk from 2-2:15 at the Multimodal Intelligence workshop (204C) on our work โNot All Features are Created Equal: A Mechanistic Study of Vision-Language-Action Models.โ
Will also be at the Unifying Concept Representation Learning workshop (209) presenting โGluing Local Contexts into Global Meaning: A Sheaf-Theoretic Decomposition of Transformer Representations.โ
Feel free to stop by if you want to talk VLAs, Robotics, or Algebraic Topology!
I'm very excited to finally announce one of the most ambitious projects we've worked on โ which makes the front cover of Science Robotics today:
โ๏ธ Learning a Thousand Tasks in a Day โญ๏ธ
Everyday tasks โ like those below โ can now be learned from a single demonstration each...