What machine learning tools do Kaggle champions use? We ran a survey among teams that ranked in the *top 5* of a competition since 2016.
The first question asked about the *primary* framework they used.
Very happy to see confirmation that winning teams prefer Keras :)
I passed my PhD defense today! ("Weak Supervision from High-Level Abstractions"). Main idea: even though ML models (like computers) run on 1s and 0s (individual labels), we can program them using higher-level interfaces. Thank you to so many people who helped me get to this day!
The followings deserve your attention, trust me. When I saw both I was like “Holy 🐄!”!
Jupiter notebook on neural ODE (and useful links!!): https://t.co/2YIhkvxqsh
Blog post on neural ODE: https://t.co/lRMxkfTiKk
This is why we wrote our #nlproc book using barebones PyTorch with good software engineering practices. We were tired of seeing either high level code or poorly written code. Our emphasis is on depth and practice, so you can go create that “superbestlibrary” for your domain/task.
We have just released FaSTGAN!! A 32 fps video object segmentation model based on Spatio-Temporal GANs that does not require fine-tuning :)
https://t.co/FtJpaxZ0Z1
Wrote an end to end setup for @fastdotai on GCP for v1. I had trouble finding resources to get this started as directions are quite scattered across blogs + non trivial steps weren't obvious. This should help beginners get started for free.
@jeremyphoward
https://t.co/0aZtCknHgM
My Coursera MOOC "Neural Networks for Machine Learning" was prepared in 2012 and is now seriously out of date so I have asked them to discontinue the course. But the lectures are still a good introduction to many of the basic ideas and are available at https://t.co/HBbKhA6o8q
My PhD thesis Neural Transfer Learning for Natural Language Processing is now online. It includes a general review of transfer learning in NLP as well as new material that I hope will be useful to some.
https://t.co/PxfVRYuyjx
10 Exciting Ideas of 2018 in NLP: A collection of 10 ideas that I found exciting and impactful this year—and that we'll likely see more of in the future.
https://t.co/iv29bxYbq4
My AAAI 2019 Highlights—including dialogue, reproducibility, question answering, the Oxford style debate, invited talks, and a diverse set of research papers
https://t.co/18VMsdgmdi
My applied machine learning class starts getting to the more meaty bits, we're at preprocessing now: https://t.co/S8UoyYrcRm I realize my slides are still no-where near where I want them to be. But slowly getting there.
This is a super cool resource: Papers With Code now includes 950+ ML tasks, 500+ evaluation tables (including SOTA results) and 8500+ papers with code. Probably the largest collection of NLP tasks I've seen including 140+ tasks and 100 datasets.
https://t.co/lTAGE7LGZY