2023 was the warmest year since global records began in 1850 by a wide margin.
The 10 warmest years in the historical record have all occurred in the past decade (2014-2023).
Had an insightful conversation with @geoffreyhinton about AI and catastrophic risks. Two thoughts we want to share:
(i) It's important that AI scientists reach consensus on risks-similar to climate scientists, who have rough consensus on climate change-to shape good policy.
(ii) Do AI models understand the world? We think they do. If we list out and develop a shared view on key technical questions like this, it will help move us toward consensus on risks.
I learned a lot speaking with Geoff. Let’s all of us in AI keep having conversations to learn from each other!
New Nature paper provides evidence that science has become less innovative since the 1950s. The authors suggest reversing the trend by:
1. reading widely,
2. focusing less on quantity of papers, & more on research quality,
3. taking year-long sabbaticals.
https://t.co/oYV5JCXRl8
1/9 Paper is out https://t.co/qzSCPHFQPn
Here's some takeaways including new tidbits (good & bad!) since the preprint & even after the paper was accepted.
Large sample sizes are helpful for individual-level prediction. We have known that for quite some time, but the recent...
Introducing Flamingo 🦩: a generalist visual language model that can rapidly adapt its behaviour given just a handful of examples. Out of the box, it's also capable of rich visual dialog.
Read more: https://t.co/xEzqTizoJQ 1/
Dataset distillation enables #ML models to be trained using less data and compute. Today we introduce two novel dataset distillation algorithms and release their distilled datasets, which yield state-of-the-art results for image classification. https://t.co/y17QqSB6U4
Today we're releasing three new papers on large language models. This work offers a foundation for our future language research, especially in areas that will have a bearing on how models are evaluated and deployed: https://t.co/TV05K4zptv 1/
The ongoing consolidation in AI is incredible. Thread: ➡️ When I started ~decade ago vision, speech, natural language, reinforcement learning, etc. were completely separate; You couldn't read papers across areas - the approaches were completely different, often not even ML based.
#NeurIPS2021 What's a good imputation to predict with missing values?
• With powerful learners any imputation works asymptotically
• Finite sample: conditional imputation (aka the one people like) is not best option
• Better learn imputation
https://t.co/GD2Yp62J8k
🧵1/6
I am looking for a postdoc with PhD training in neuroscience, machine learning or related field. Topics are quite flexible (https://t.co/g1l1d17ajG) and up for discussion. Appreciate RT.
After advising PhD & Master students for over a decade, there is one thing I find most students need to unlearn: the half-ass work mentality acquired during years of tests and homework. Let me explain (thread 🧵). 1/N #AcademicTwitter
Many models bake in domain knowledge to control how input data is processed. This means models must be redesigned to handle new types of data.
Introducing the Perceiver, an architecture that works on many kinds of data - in some cases all at once: https://t.co/2OAMwt61ru (1/)
1/3 Our study on individual-specific areal-level parcellations is out https://t.co/Fs5IfbqVwQ
Multi-resolution HCP parcellations & FC matrices found here https://t.co/WP7kpOmlyc
Spearheaded by @rubykong92 @gordonneuro @zuoxinian @Nathan_Spreng @getian107 @AvramHolmes @INM7_ISN
“Present extinction rates in European freshwater gastropods are three orders of magnitude higher than even revised estimates for the Cretaceous–Paleogene mass extinction, which resulted in the extinction of 92.5% of all species.” https://t.co/V7lGE5m64p
Coming up soon: a mooc to learn machine learning in Python with @scikit_learn
https://t.co/mkf8g2x44x
8 weeks, 4.5Hrs/wk, from zero to hero in machine learning: from knowing only basic Python to understanding ML
Brought to you by @InriaLearnLab@sklearn_inria & @Inria_Academy
Come check out my upcoming poster #1826 for #OHBM2020 entitled "Mapping Systematic Changes in Community Assignment Across Parcellation Resolutions". Reprints, recordings, and supplementary information at https://t.co/ltNzmsDsvV; live presentations on Zoom to be announced in chat!
Unsupervised Translation of Programming Languages. Feed a model with Python, C++, and Java source code from GitHub, and it automatically learns to translate between the 3 languages in a fully unsupervised way. https://t.co/FpUL886KS7
with @MaLachaux@b_roziere @LowikChanussot