@seohong_park Great read! How are you addressing the geometric symmetry of the cube when you are feeding the state inputs? Does anything change if you represent orientation as (roll-axis re-ordered from largest to smallest, roll % 90 deg) instead of quaternion (presumably what you are using)?
A bit of throwback from the last year, but we presented CLASS in CoRL 2025, an action-centric representation learning framework that induces policy invariance to useful properties like camera viewpoints, object visuals, etc.
If you find our work interesting, please try it out! Also, feel free to reach out if you talk more in this direction. We hope that this work opens up more opportunities toward learning strong action-centric vision representations.
Project webpage: https://t.co/7V5R1hb0cY