Tested #OpenAI ’s Whisper to translate a mix of languages to English fluidly, the results are 🤯. We demo using Filipino, English and Japanese.
We’d love to know what creators are thinking so we are opening a waitlist to try it yourself!
Sign up at https://t.co/pp04BdtndA🙌
NLP+CSS 201 (co-org w/ @alethioguy) is back! Social scientists, “level-up" your skills and join us for free, online, hands-on tutorials on text preprocessing, dialogue analysis, multilingual modeling, causal inference, uncertainty quantification, and more! https://t.co/G1wFQaX5yC
The 104B model training @BigScienceW had a 2nd BREAKTHROUGH after we added an Embedding LayerNorm. We discovered it while experimenting with BNB https://t.co/X1KdSIZZNC
But, alas, we run into new problems 10k iterations later.
Chronicles are here:
https://t.co/sUIpUS0cAG
Introducing #AlphaCode: a system that can compete at average human level in competitive coding competitions like @codeforces. An exciting leap in AI problem-solving capabilities, combining many advances in machine learning!
Read more: https://t.co/yaXfMWtEfe 1/
We thank @svlevine for his excellent talk "Data-Driven Reinforcement Learning: Deriving Common Sense from Past Experience" last Friday, now available on our YouTube channel. https://t.co/RfFMxmLivj
Reinforcement Learning Day 2021 will feature a lively debate between Prof Yoshua Bengio from @Mila_Quebec and Dr. @JohnCLangford. Reserve your seat now to watch their discussion on “The State of RL and The Theory-Practice Divide” on January 14 at 11 AM: https://t.co/mZJIG6rHYw
Great progress in speech recognition: wav2vec 2.0 pre-training + self-training with just 10 minutes of labeled data rivals the best published systems trained on 960 hours of labeled data from just a year ago.
Paper: https://t.co/niBzDiei1j
Models: https://t.co/frCK1GJMZQ
Want to learn representations that generalise in a self-supervised way? Our researchers propose ReLIC to show how to leverage causality to learn robust representations: https://t.co/HOUJtTMzg6
Work by @jovana_mitr, Brian McWilliams, Jacob Walker, Lars Buesing, @blundellcharles.