Transformers have shown remarkable capabilities - but can they improve themselves autonomously from trial and error?
New research shows how a single transformer can explore and solve tasks using this method without ever updating its parameters โก๏ธ https://t.co/8af0uOIzBl
Lightning Pose: Convolutional Networks for pose tracking implemented in PyTorch Lightning, supporting massively accelerated training on unlabeled videos using NVIDIA DALI.
We totally agree that Lightning is one of the coolest DL packages around. ๐
Repo: https://t.co/OoVs5U4Fmc
On April 21st I'll be presenting https://t.co/NCly5F5WT8, a machine learning studio based on @PyTorch at the Pytorch Ecosystem Day. Register now at https://t.co/Vo4ZSOsBLA ! #PTED21#PyTorch#DeepLearning#AI
We just open-sourced differentiable SDE solvers in PyTorch:
https://t.co/v1f08mjgCq
Now you can put stochastic differential equations in your deep learning models, and neural nets in your SDEs! Credit to @lxuechen.
Optuna is a black-box optimizer. Learn how you can use Optuna to create the objective function, define the hyperparameters, run trials, and perform pruning to optimize PyTorch hyperparameters.
https://t.co/2U6vsZEg6K
Excited to announce the open source of EfficientDet: better accuracy & efficiency on COCO detection. Bonus: it also works pretty well for semantic segmentation (Table 3)!
Paper: https://t.co/tO1mtfuaKx
Code: https://t.co/pzfNoM6IS5
I built my first python package: jupyterplot! Plot real-time results in Jupyter notebooks.
https://t.co/KGk1YZWJWW
It is founded on @andreas_madsen's excellent python-lrcurve library.
Effortless development and publishing with #nbdev by @jeremyphoward and @GuggerSylvain.
Facebook AI is open-sourcing a new, easy-to-use, end-to-end framework for large-scale, state-of-the-art image and video classification tasks. It enables anyone to train models on top of @PyTorch using very simple abstractions. #NeurIPS2019
https://t.co/0wAf2fqXQK
Can we use deep RL to learn from data, rather than from online interaction? Aviral Kumar discusses challenges and recent work in this area, including our algorithm BEAR for fully-off policy RL: https://t.co/XUYxsE3mNK
1/4: The lottery ticket hypothesis suggests that by training DNNs from โluckyโ initializations, we can train networks which are 10-100x smaller with minimal performance losses. In new work, we extend our understanding of this phenomenon in several ways... https://t.co/fbEKjgeG6Y