A first glimpse of the wildest robotics project of my PhD.
๐น The Blind Skateboarder ๐น
No vision. No markers.
Paper, code, weights โ coming soon. And we have more. ๐
Most motion papers tailor one controller to one specific task. This year at SIGGRAPH, our research team asks: can motor control itself be pretrained and reused?
Generative Pretrained Controllers, or GPC, turn motor skills into a vocabulary of discrete tokens and train a transformer-based generative controller through next-token prediction. Just like GPT, the same pretrained controller can then be fine-tuned to solve new tasks.
Trained on 600+ hours of motion, GPC runs in real-time inside a physics simulation, producing natural and physically grounded behaviors for interactive control.
Interested in discrete latents?
Iโll be presenting a new method for training discrete VAEs at ICLR in Rio ๐ง๐ท
๐ Pavilion 3, P3-605
๐ Thu, Apr 23 @ 11:15
More details below ๐
DAPS: Discrete Variational Autoencoding via Policy Search (accepted @iclr_conf)
A principled way to train discrete autoregressive encoders โ
without straight-through gradients.
Entropy reg. + KL trust region
for stable training and compact latents.
๐ https://t.co/SJgESLqTrf
DAPS: Discrete Variational Autoencoding via Policy Search (accepted @iclr_conf)
A principled way to train discrete autoregressive encoders โ
without straight-through gradients.
Entropy reg. + KL trust region
for stable training and compact latents.
๐ https://t.co/SJgESLqTrf
Step 3: Optimal target distribution.
Solve a KL-constrained optimization problem
to get a closed-form non-parametric target q*.
Update the parametric encoder toward q*.
๐งต Accepted at @iclr_conf !
Target networks stabilize bootstrapping in RL ๐ก๏ธ
But induce slow-moving targets ๐ข
Online networks adapt fast โก
But can diverge with function approximation ๐ฅ
๐ ๐๐ก๐ง๐ข๐ฟ uses the online network ๐ผ๐ป๐น๐ ๐ถ๐ณ ๐ถ๐ ๐ฐ๐ฎ๐ป โ yielding faster and more stable RL.
Hereโs how ๐
Something exciting just arrived at our lab! Here's a hint: precision mechanics, intricate wiring, and a touch of power. What could it be?
A) High-end lab equipment
B) Experimental space probe component
C) Something that might walk past you in the hallway.
Share your guesses!
@asurobot@davide_tateo@_bbelousov@SimonStepputtis Will always have a special place in my heart for IRL... Similar research, just in a different country ๐ Weโve got some cool humanoids on the wayโexciting times!!