Chinese personnel on the scene forcefully blocked reporters who attempted to photograph the senior official entering the U.S. Treasury building that morning. When journalists asserted that “you have no authority to obstruct press freedom,” a Chinese official responded, “We have the right to refuse the filming of our personnel,” and demanded that all photos taken with smartphones be deleted.
When reporters asked the individual obstructing coverage to identify himself, he refused, saying, “I am not obligated to disclose my identity.” However, the ID badge he was wearing displayed his name, photo, and the nationality “China.”
FOCUS proposes a new building block compatible with all(!) existing optimizers, improving stability and accelerating convergence!
TL;DR: Use L1 Weight Decay to EMA
https://t.co/s9v2My9frA
I'm excited to announce a new project: "Algorithmic Lens"
For the first post, check out "A Deep Dive into Modern Deep Learning: An Extensive Reading List for Experts of other fields" at https://t.co/m1xZuyTvy9
"Free IVF, folks, it's all going to be free. And we're bringing in a very smart guy to help with that. Steve Hsu. HSU. Pronounced like Shoe but not spelled. HSU.
We're gonna select those embryos. Only the best. We might—we might even edit them..."
In 1956, Kurt Godel wrote to John Von Neumann a letter describing the implications for a machine that searches for finite proofs to mathematical statements efficiently, avoding the halting problem.
An Artificial General Intelligence would be such a machine.
LOMO optimizes PyTorch by fusing the optimizer update with the backward pass. This fusion eliminates temporary gradient storage, reducing memory* usage 3x compared to SGD with activation checkpointing!
*caveats; see below
1/8
https://t.co/hnnspmG27n
Perhaps the most misunderstood idea in the "empirical" sciences is that a correlation of 90% is closer to 0 than 1.
We shd train students to *visualize* rather than absorb formulas nonprobabilist statisticians can't understand.
(See my comment on IQ)
https://t.co/r5mlHRUMpQ