Jo Warren

PhD student @ Sainsbury Wellcome Centre
🇵🇸

[Jo Warren @jowarrn]

@HuaDongXiong There's no Q here - all the values are action-invariant, whereas Q-values are action-specific. However, item x rank is correlated (but subtly different) to item x value (Q), so in problems with 2 options the rank swaps might appear similar to anti-correlated Q updates.

[Jo Warren @jowarrn]

Special thank you to my co-authors @jcrwhittington @KrisTorpJensen @behrenstimb!!

Paper: https://t.co/TvDnDHbRsW

Questions and feedback very welcome! 14/14

[Jo Warren @jowarrn]

Is meta-RL in PFC just a big RNN or can we figure out its mechanism?

Here we show that RNNs learn a particular, but general, method for meta-RL. They place options in 'ranked’ subspaces (slots), and dynamically re-rank them. Value doesn’t pick the action; it reorders the slots🧵

[Jo Warren @jowarrn]

In sum, this model unifies the value & schema accounts of PFC function. Value controls the reorganising of memories-just like how actions do when navigating a cognitive map. Though we studied simple behaviours, we think these primitives might help us understand complex ones 13/14

[Jo Warren @jowarrn]

@silkennart @BlackXList @istreasatuatha Hate the condescending way people portray centrism as the ‘grown up’ option. Wtf do you think the tories will do when he matches all their right wing policies? Obv just move further right… After a Starmer term of austerity we’ll get a far right gov, just like Trump 2024 in US.

[Jo Warren @jowarrn]

@HeatherBevan @TameeOliveFern @monarelief Weird energy to come with. Your article is from 2021. In dec 2023 it was suspended. Whether it was a political decision or not is speculative, regardless people are starving. I merely shared a link to a relief org that operates independently of WFP, no need to get so riled up

[Jo Warren @jowarrn]

@TameeOliveFern World food programme has suspended food aid to Yemen, because of their support for Palestine according to Al Mayedeen

@monarelief do work on the ground there distributing aid