I want to offer some unsolicited advice to computer vision researchers jumping into robotics. Don't focus too much on VLMs, VLAs etc. That's fine, but the real action is at the sensorimotor level. Most of the open problems in robotics are in manipulation, which is about hand-object interaction, and contacts and forces are central. Proprioception and tactile sensing are as important as vision. Don't get seduced by cherry-picked demos. You can't do robotics without doing robotics.
go to bed
right now
i know the build is almost finished
the eval can wait til morning
the agent will still be failing tomorrow
you won't figure out why it's hallucinating
yes your coworker ships on 4 hrs of sleep
they also hallucinate a lot
off you go
I've found it unexpectedly useful to memorize facts about systems I work with.
Knowing these numbers allows one to 1. sanity check performance, 2. sketch out feasibility of technical solutions, and 3. reason about performance characteristics.
Some examples below: (1/7)