Next time, curvature! Notes will be available online soon๐
An Introduction to Differential Manifolds (Barden &ย Thomas) and Introduction to Smooth Manifolds (Lee) were used in preparation ๐
@deepthinkhour events are supported by @Ellis_Amsterdam and hosted at @UvA_Amsterdam
Last week, we wrapped up the first part (Foundations) of the "Differential Geometry for Deep Learning" series! ๐
Thanks to all the attendees and of course @davidmknigge, @samuelepapa_, and @RValperga for making these lectures possible!
โจGood news!ย The lovely @gabel_alex is back to give the second lecture of his tutorial series on "Differential Geometry for Deep Learning" at @deepthinkhour.
In this follow-up Alex will treat a bunch of new topics, as well as showcasing a number of practical applications ๐
๐ฅ We are excited that @davidwromero (@nvidia) will talk about 'Beyond Transformers: Exploring Subquadratic Long-Context Architectures' at the upcoming Deep Thinking Hour Tutorial!
๐ Thu, April 11th
โฐ๏ธ09:00 - 11:00
๐L1.01 of @Lab42UvA
Come and deep think with us! ๐
๐๏ธ Reminder! @phillip_lippe's tutorial on training massive deep learning models is happening this afternoon at 17:00 CET in C0.110 SP904.
Also live-streamed over zoom. For info and links:
https://t.co/exhuB0hdK0 โจ
We also propose using a suite of 25 PDEs labeled by their non-canonical symmetries for experimenting with neural symmetry detection beyond rotation, scaling and translation! (n/n)
And, of course, big thanks to my supervisors Stratis Gavves and Rick Quax here at @UvA_Amsterdam!
Our work got published in Machine Learning: Sci & Tech! ๐ @egavves@MLSTjournal
We propose a method for encoding complicated symmetries pervasive in scientific data, apply it to neural symmetry detection AND argue for more diverse PDE datasets! (1/n)
https://t.co/lUuUn1Z6al
In a straightforward experiment, we show how symmetry detection can be done for PDE data using this encoding. In some cases, parts of correct symmetry transformations were identified when applied to unseen dynamics ๐ Exciting possibility for further work! (3/n)
Do you want to train massive deep learning models with ease? Our 10 new tutorial notebooks of our popular UvA DL course show you how, implementing data, pipeline and tensor parallelism (and more) from scratch in JAX+Flax! ๐๐
Check them out here: https://t.co/7AtaB7j8l9
๐งต 1/11
The @UvA_Amsterdam and @ELLISforEurope are starting a masterclass series where experts explain all about their favourite topics in and around Machine Learning.
Join us for the first on March 6th; "Differential Geometry for Deep Learning" masterclass by @gabel_alex. โจ
๐
I have two #PhD openings in #ComputerVision on 'Detailed Video Understanding' at @LIACS@UniLeiden.
Apply before 10th November. More info ๐
https://t.co/zMN6yEHywQ
Check out our poster on Neural Symmetry Detection this morning at TAG-ML! (Room 317B at 11.10am) @TAGinDS#ICML2023
Work with: @klein_vick @RValperga @kn_webster Jeroen Lamb @RickQuax & @egavves
https://t.co/FaeQB27yJQ
Tired of tuning neural architectures by hand every time you have a new dataset, modality?
Meet ๐๐๐๐ซ๐๐ก, a method that jointly learns:
โข The size of all conv kernels
โข The width of all layers
โข Downsampling layers &
โข The depth of the nets
all by backpropagation! ๐ฅ
Iโm at ICML in Hawaii this week! ๐โโ๏ธ ๐ธ โ๏ธ
Let me know if youโre around and want to meet up โ๏ธ
Weโre presenting our work on Neural Symmetry Detection on Friday at the TAG-ML poster session ๐ค ๐
#ICML2023
Link: https://t.co/FaeQB27yJQ
In a new blog post, I summarize and reflect on some of the themes of our Simulation-based Science colloquium, which we recently concluded @UvA_IAS.
I learned a lot from our excellent speakers, and I am excited to see what future iterations will hold!
https://t.co/QKcB6AmeoL