New preprint: "Stability and Generalization in Looped Transformers"
Looped transformers are having a moment. Part of their appeal is the theoretical possibility of generalizing to harder problems simply by running more loops. But in practice, that often fails. 🧵
I love the way the #Nats are progressing but something has to be done about bad baseball IQ. How in the world do you get picked off 3rd base? They just sacrificed an out to get you there. The entire job is to score from there and you’re trying to do what? So sloppy
@josemorgado Was there last night. Was weird. Shops closed early and food closed earlier too. Doesn’t give the sense they want people to hang out more.
@EvanMGlass I can’t believe that there is no map showing where plows are in the neighborhood. Not like the tech doesn’t exist. This just shows that I am in a stage 4. Not helpful