Norm

PhD student. Deep RL. Probably trading crypto. Prev: @ScaledInference & @Flipboard. Move against the grain. 🇨🇦

[Norm @normantasfi]

Excited to share our recent work combining model-free and model-based RL methods for planning. Our approach drastically reduces the number of planning computations and we see emergent search patterns (depth-first and breadth-first) used during planning.

https://t.co/NZHxvihzKA

[eder @edersantana]

📜 This is our poster with @normantasfi and Miriam Capretz for the Preregistration Experiment at NeurIPS! If you are interested in transfer learning for RL, stay tuned for updates!

[Norm @normantasfi]

@jdcampolargo This is something I’ve thought a lot about and don’t think there is any one single cause. With that said, I think a large contributing factor is that as you get older more of your life is nailed down.

[Norm @normantasfi]

@dennybritz What would you consider semi-MDPs (ala options) to be?

[Norm @normantasfi]

@eigenhector I feel personally attacked by this tweet

[Norm @normantasfi]

@IMordatch @brandondamos @jhamrick enjoyed the QA! thank you

[Norm @normantasfi]

@dcreemer @Flipboard @mmccue Good luck on what’s next! Was great working with you

[Alexis Gay @yayalexisgay]

every single party in San Francisco👍

[Norm @normantasfi]

@jacobmbuckman Why not provide an anonymous email instead? You can have the longer back and forth over email without revealing yourself.

[Gurwinder @G_S_Bhogal]

MEGATHREAD TIME: In 40 tweets I will describe 40 powerful concepts for understanding the world. Some are complex so forgive me for oversimplifying, but the main purpose is to incite curiosity. Okay, here we go:

[Norm @normantasfi]

@edersantana I have not. You might be able to phrase it as a ranking problem. I know you can use bandits in this way if you want to do ~RL.

[Norm @normantasfi]

@kevin_zakka @edersantana 100% how @edersantana is. 13/10 human

[Norm @normantasfi]

@noahsark769 Couldn’t you say a large percentage of code is trivial? Maybe that part can be automated away?

[Norm @normantasfi]

@cgenco @Shpigford The iPad works great for me but most of my work falls into one of: code (research or server side), plotting, writing, or reading papers. I will admit that there is some clunkiness, eg. when you are doing heavy multitasking, but I found the setup to be quite productive.

[Norm @normantasfi]

@cgenco @Shpigford I usually ssh onto a server and use tmux+vim+git etc. I have ESC mapped to Caps lock (via Blink). When I need to port forward it lets you do that with the usual ssh flags so using other apps like Juno (ipython) is easy.

[Norm @normantasfi]

@noahsark769 You should trade on it.

[Norm @normantasfi]

@Zergylord @awjuliani Instead of a tv with static we can distract RL algos with training curves

[Norm @normantasfi]

@janexwang Lathe of heaven by Ursula K. and Ubik by Philip K. Dick are great!

[Norm @normantasfi]

@emilsjolander Yes, it is lacking in this area. I rely on ssh+tmux+vim here.