@karpathy Potentially some time decay combined with LRU memory is needed. But completely removing the memory isn't ideal. As humans, we don't remember the memory but build vague "feel". So potentially memory decay combined with LRU where instead of deletion, we "quantize" down the memory?