@SchmidhuberAI Thanks for this historical video. That said, calling the training algorithm "modern" backprop is like calling Macsyma the "modern" calculus. There's no modern backpropagation. The correct word is "automated".
@MartinSLewis Should social media allow anonymity? Civil litigation is a key tool for redressing harms, but can’t work against anonymous bad actors. Vetting of identities by a 3rd party could help make them liable by giving the law and victims access to their identities via court order.
@SchmidhuberAI You say BP as the reverse mode of *automatic differentiation*, but I used it in the 80s to solve problems of open loop control and seismic inversion. I got it from Bryson and Ho's 1969 book, and they cite Lanczos's book from 1947. What gives you the right to misappropriate it?
@egrefen The beauty of poetry (and in this case lyrics) is that the context each individual brings to the song generates a uniquely personal interpretation.
@demishassabis We can start by thanking Claude Shannon who demonstrated that computational operations could be implemented with switches, and then William Shockley and his team who invented the first solid state switch (aka, the transistor)! The rest, just iterations of gradient descent :-)
@NeelNanda5 In my opinion, a strength of conferences is the opportunity for interpersonal interactions -- I don't think this is a superficial benefit. Journals provide the option to publish without presenting, so maybe conference organizers have a point?
@docmilanfar Jeff's approach was, in my opinion, completely intuitive. The key idea is that zero-mean RVs are vectors, with cross covariance the inner product and the root auto covariance the distance metric.
@docmilanfar I was introduced to the Kalman filter in 6.432 Stochastic Processes, taught by Jeff Shapiro. Took 6.452 Stochastic Filtering with Alan Willsky (who was also my thesis supervisor).
@mpatti Here’s how I see it for myself: (1) I enjoy working on skills (juggling, close-up magic, trick roping, and now jazz guitar). For me, there is pleasure in the pursuit of mastery over mind and body… it has a joy of its own.