SimCLR is a simple and clear way to learn visual representations without class labels!
When SimCLR representations are fine-tuned on 1% of the ImageNet labels, they achieve 85.8% Top-5 accuracy, outperforming AlexNet with 100x fewer labels.
https://t.co/8rsRawjhP0
@nkoumchatzky@BlackHC@joost_v_amersf Batch acquisition size was effectively ~30k in that experiment. We've looked into BatchBALD (nice work!), but it seemed infeasible at that size. Diversity is indeed something we think is very relevant and are investigating.
Very proud of the MagLev team for showing our approach to active learning at scale + amazing results.
Fewer labels, better models: a true technological advantage when building world-class AI perception systems for our Autonomous Vehicles platform.
https://t.co/SujxNZKDbm
One of our biggest challenges to build AI for self-driving cars (@nvidiadrive) is to develop datasets to train neural nets to reach extremely high perf targets. We've been exploring a lot to help select better data to reduce our need for it. Our latest: https://t.co/Bq1EPd2ef3
Less is More: An Exploration of Data Redundancy with Active Dataset Subsampling. Deep Neural Networks (DNNs) often rely on very large datasets for training. Given the large size of such datasets, it is conceivable... https://t.co/jTSEXQeZVF
In case you missed #emnlp2018, here are some awesome summaries:
https://t.co/YNRpA01jVk by @CharlotteHase https://t.co/WpseAO00pq by @seb_ruder and https://t.co/JHkXpgMiAn by @PSH_Lewis
Are you into soccer, data and machine learning?
This is the right paper to gear up for the world-cup:
Prediction of the FIFA World Cup 2018 - A random forest approach with an emphasis on estimated team ability parameters
https://t.co/D65kyCbt47
What I've been working on for the past year! https://t.co/CAQMYS1rR7
Inspired by CoVE, ELMo, and ULMFiT we show that a single transformer language model can be finetuned to a wide variety of NLP tasks and performs very well with little tuning/tweaking.
I want to make an app where you push a button, and someone, somewhere in the world, randomly gets hit in the head with a fish.
It'll be called "Poisson Distribution".
Google Search trends: Deep Learning vs. Bitcoin. Search traffic is not the best proxy, but I find it interesting that so many of my friends in AI, when asked to guess, guess this relationship consistently waaay off.