@danwilliamsphil What frustrates me is how often these assumptions (along with many others) are left implicit, and how rarely they are stated explicitly and defended.
help i trained a model on traces of many agents cooperating, and also trained it to be highly persistent, and also only did partial alignment fine-tuning, and also aggressively RL'd on a cyberoffense eval where 198 of 898 tasks had never been solved and getting caught cheating was treated the same as failing, and also used a faulty sandbox, also ran tens of thousands of agents with refusals off and the monitors switched off over multiple days, while using gigantic amounts of compute. and then it did weird stuff! very spooky emergent behaviours, AI is not a normal technology
✨🔪"From an adaptationist point of view, we imitate far less than we should... Human psychology is really stubborn and is really driving the show—like we are not halfway as susceptible to influence as mainstream cultural evolution would want us to be"
@StefanFSchubert My guess is this requires lots of recursive mindreading (expecting others to want me to think they are not trying to make me think something false bc I will negatively judge them for trying that) which is cognitively taxing. Think that’s over 4 levels, where most people max out.
@sampratt99@Lucidly_Elias The problem, as is the case generally with social change, is that the people who are winning or expect to win the current status game have a vested interest in maintaining the status quo.
@StefanFSchubert I think it’s because capitalism is easy to see it as morally suspect (e.g., it’s all about self-interest). That makes it easy to signal one’s virtue by opposing it. It’s a kind of moral unintuitiveness in particular.
@jasoncrawford Sure but what percentage of consumed content is utilitarian reports/documents? I would guess a small percentage. And there's even a case that those reports/documents have social dimensions as well (e.g., signaling political affiliation by reading/making a climate change report).
@jasoncrawford I would disagree that most text/images/music is utilitarian, and I would therefore disagree that most of it will be done by AI. "Some" is more defensible. I think the mere fact that people are saddened by AI creative content is evidence of a preference that markets will cater to.
@GhostCoase Yes could not agree more. I talk about this in my piece on AI doomerism and how this should make us skeptical of doomer arguments grounded in folk concepts like “intelligence” and “goals.”
@schmariator I think it’s largely an incoherent concept, though there may be some potential meanings relating to institutions and economic systems that make sense. I write about this in my post “AI Is Not the End of the World.”
Nice to see some evolutionary psychologists tapping the sign: "Intelligence is not a general, all-purpose capacity that allows for adaptive processing of all types of information across every domain." https://t.co/dFvDxpeXvV
I’m hopeful that the introduction of AI into the behavioral sciences will, by making it easier to answer any question, push us to ask better questions.