I want to offer some unsolicited advice to computer vision researchers jumping into robotics. Don't focus too much on VLMs, VLAs etc. That's fine, but the real action is at the sensorimotor level. Most of the open problems in robotics are in manipulation, which is about hand-object interaction, and contacts and forces are central. Proprioception and tactile sensing are as important as vision. Don't get seduced by cherry-picked demos. You can't do robotics without doing robotics.
I am genuinely frustrated by how poorly self-supervised learning for vision is researched and how underappreciated it is.
Like how has DINOv2 been basically the best model for the past 3 years lol
Such a great evening to start a brand new research for NeurIPS in 3.5 days.🧘♂️
Day 1: planning.
Night 1: running experiments and sending the abstract.
Day 2: reading results fighting with Claude, and sending again.
Night 2: sleep (optional).
Day 3: opening Codex, and finally, write the pape in parallel.
Night 3: resolving the “beef” with Claude (temporary peace) and going to sleep.
Day 4: final reading, last-minute fixes, submission then some relaxation, maybe a beach walk.
I’ll keep you posted on the results.
This will be my only single-author paper, so I can’t hide behind other submissions if it gets rejected 😅