I'm happy to share that our paper was accepted as a #NeurIPS25 spotlight! This is the first linear CMDP algorithm with sublinear regret and episode-wise safety.
Grateful to my amazing collaborators @omron_sinicx (esp. @Tdash_Koz) and @Arnobg32
https://t.co/LeUNyoGC4F
I can nominate one Canada Impact+ postdoc candidate at UAlberta. Please reach out only if you have a strong theory track record (learning theory/bandits-RL theory/LLM reasoning). Deadline: May 10 (23:59 MT. Email: CV + best papers + brief pitch. Pls RT https://t.co/pnRmnxPyCi
This means that the sim-to-real gap is not just a matter of better tuning or larger-scale experiments. It reflects a deeper computational barrier in robust reinforcement learning. This work is led by @t_kitamura14
Please see here.. (n/n)
https://t.co/qAH6ROYnPI
🧐🧐 Why do we pretrain LLMs with log likelihood? Why does action chunking work so well in robotics? Why is EMA so ubiquitous? And could their be a mathematical basis for Moravec’s paradox? 🤖🤖
Come check out our NeurIPS 2025 Tutorial “Foundations of Imitation Learning” with @canondetortugas and Adam Block, Tuesday 130-4pm, to find out! (🧵for details)
@karpathy@karpathy I think it would be good to distinguish RL as a problem from the algorithms that people use to address RL problems. This would allow us to discuss if the problem is with the algorithms, or if the problem is with posing a problem as an RL problem. 1/x
My 3rd blogpost on PG, the topic I am least familiar with but get asked a lot, so I thought I'd just put together the very limited stuff I know on this topic. Somehow the post gets cynical from time to time🙃
https://t.co/bD7coJJ7mI
As AI is replacing human decision-making, it is important to sit back and consider the risk aspect of the cost associated with the decision. In this podcast, I talked about our recent ICML paper (https://t.co/h1SV8cHEsl) on risk-constrained MDP. Thanks @executive_code#AIrisk
Excited to share that I’ll be joining the University of Alberta as a postdoc next week! 🎉 I’ll be working on RL theory in Csaba Szepesvári’s lab at Amii!