This post really highlights why I’m baffled by mainstream approaches to interp that ignore learning dynamics. To me the natural interpretation of “but why?” requires that you talk about training data and reward signals.
@idavidrein do you think it’s possible that there are sentient entities whose qualia don’t bear valence in the same sense as they do for us? i.e. sentient beings incapable of suffering
@jarredsumner@bshlgrs openai is not constrained by money, but it is constrained by gpu supply. there is just not enough. everyone is running at 95+% utilization and is strongly incentivized to optimize inference