Disappointed with your ICLR paper being rejected?
Ten years ago today, Sergey and I finished training some of the first end-to-end neutral nets for robot control 🤖
We submitted the paper to RSS on January 23, 2015.
It was rejected for being "incremental" and "unlikely to have much impact"
Our resubmission to NeurIPS was also rejected
It now has >4,000 citations (and more importantly, end-to-end training is widely accepted!)
It's also cool to think about what's changed and what's the same --
- The network was 92k parameters and trained on ~15 minutes of data
- The code was a combination of matlab, caffe, ROS, a custom CUDA kernel for speed, and a low-level 20 Hz controller in C++, all talking to each other. ROS+matlab was as bad as it sounds.
- We pre-trained the encoder and did inference off-board on a workstation with a larger GPU.
- We were paranoid about varying lighting messing up the network, so we did all the experiments after sunset (so long nights running experiments on the robot past 3 am)
Now, we have manipulation policies that are far more dextrous, far more generalizable, and maybe on the cusp of breaking into the real world. :)
(the paper: https://t.co/qDlGSdDExL)
Does a language model trained on “A is B” generalize to “B is A”?
E.g. When trained only on “George Washington was the first US president”, can models automatically answer “Who was the first US president?”
Our new paper shows they cannot!
This infrastructure creates freedom.
The freedom to move around the city and participate in society on our own terms, the freedom from being trapped in a metal box sitting in traffic, and the freedom from the ever-increasing economic burden of owning and operating an automobile.
Remember, Paris wasn’t “always this way.”
It wasn’t even this way in late 2019 when I was there last.
Just a few years ago, #Paris was choking in car traffic.
This is new. This is leadership.
Cities are a result of choices.
Video via @Khayat_Fouad
In a tournament costing a quarter of a trillion, designed to rehabilitate a dictatorship, with every move PR-optimised & choreographed, the fact that one enduring image of the whole thing will be a goalkeeper pretending a golden glove statue is his willy will never not be funny.
Some suggest it’s impossible, but the imperative act of reducing car supremacy is already happening in cities that stopped making excuses, and started making progress.
Sixteen places we visited in the past 12 months that made recent and radical changes to their streets.
Thread.
En honor a la salida del curso de Solidity voy a estar regalando dos meses de sub a @courseitok entre todas las personas que le den RT a este tweet desde ahora hasta la media noche de 🇦🇷 ♥️✨
El sábado al terminar el Space sorteamos este LIBRAZO 🤩 de O'Reilly entre los que me sigan y le den RT a este tuit. La persona ganadora lo retira por Chacalermo cuando guste.
Cuarta edición en inglés de “Programming Python” 🐍
No es muy reciente pero es una verdadera joya 💎
Hoy es el día del investigador/a científico/a en conmemoración al nacimiento de Bernardo Houssay. Saludamos a las personas que trabajan en ciencia e investigación en nuestro país, especialmente a quienes aportan con sus conocimientos a la lucha contra el COVID-19. ¡Feliz Día!