@anishhdiwan added six Imitation Learning and Inverse RL algorithms to RL-X: GAIL, AIRL, AMP, NEAR, TRIRL (with or without differentiable trust region layers).
Implemented in Jax and PyTorch, and fully jitted for maximum speed ๐
Feel free to check them out: https://t.co/6OEyLqlhWY
๐นContribution: We show this reward update is equivalent to mirror descent.
๐นContribution: We show that policy search over these rewards is approximate entropic mirror descent, with bounded errors in the trust-region setting. This complements our earlier work, Trust Region IRL.
๐ข New @NeurIPSConf paper with @Jan_R_Peters & @OlegArenz :
"A Geometric Perspective on Reward Function Updates in Inverse Reinforcement Learning"
We show that natural-gradient reward updates in inverse RL require no Fisher matrix at all ๐งต๐
๐นContribution: With the Fisher information averaged along the straight line to this target, the natural gradient is just a convex interpolation of the current reward and the log occupancy ratio.
That ratio is cheap to learn with a classifier, so no Fisher matrix is needed.
A first glimpse of the wildest robotics project of my PhD.
๐น The Blind Skateboarder ๐น
No vision. No markers.
Paper, code, weights โ coming soon. And we have more. ๐
Thu, Jul 9 2:30 โ 4:15 PM in Hall A (# 213)
Come by to discuss IRL, imitation learning, and how trust region policies are a cheap alternative to globally optimal max-ent IRL ๐
PS: Iโm also co-organising the โRobot Learning Socialโ with @JoeMWatson on Wed 7-9 PM in Room 300.
Thereโs been a decade-long problem in inverse RL: learning an optimal reward function requires repeated RL solves in the inner loop. We show that this is no longer necessary!
Iโm at @icmlconf presenting โTrust Region Inverse Reinforcement Learningโ (https://t.co/GDFRtq8uFD)!
@anishhdiwan and I are organising a social for robot learning researchers at #ICML2026, please swing by tomorrow evening to Room 300 if you want to chat ๐ค๐ง โก๏ธ
๐ข Excited to share that our paper ๐ง๐ฟ๐๐๐ ๐ฅ๐ฒ๐ด๐ถ๐ผ๐ป ๐๐ป๐๐ฒ๐ฟ๐๐ฒ ๐ฅ๐ฒ๐ถ๐ป๐ณ๐ผ๐ฟ๐ฐ๐ฒ๐บ๐ฒ๐ป๐ ๐๐ฒ๐ฎ๐ฟ๐ป๐ถ๐ป๐ด (๐ง๐ฅ๐๐ฅ๐) has been accepted at @icmlconf 2026!
๐ Webpage: https://t.co/JCvZIq6NiJ
๐ Paper: https://t.co/GDFRtq7WQ5
#ICML#ReinforcementLearning#Robotics
๐ฅ We get desirable properties like monotonic improvement and a globally meaningful reward.
๐ 2.4ร improvement over SOTA IL baselines on MuJoCo & Robotics tasks (Unitree G1/Go2).
๐ Learns rewards that capture the expert's intrinsic motivation and transfer to new dynamics.