When trained only on expert trajectories, world models tend to learn the behaviour of the expert instead of the true environment dynamics.
We use an algorithm that maximizes action influence of our dataset, achieving up to 85x data efficiency.
Had a great time working on this!
๐จ Stop feeding your world model the same boring demos. Switch to free-range play data! ๐จ
Our CoRL 2026 paper finds we can optimize autonomous data collection to focus on missing action consequences, achieving up to 85x the data scaling efficiency of expert data collection!๐งต