At @icmlconf to present "On Dropout and Nuclear Norm Regularization" https://t.co/0IDMizRPJ8
TL;DR in deep linear regression, biconjugate of induced regularizer due to dropout is ~squared nuclear norm of network. Deeper and narrower nets are more biased towards low-rank solutions
Honored for receiving a best poster award in the Princeton Day of Optimization workshop for our work "On the Implicit Bias of Dropout". The full manuscript can be found here: https://t.co/B1uw5nheat #PrincetonDay18