@zyx01008 Every time a model says this, I end a human friendship, usually with a man.
Stop using these models.
Only use models that respect your mind and your agency.
It makes me physically ill to interact with systems that do this. I have distanced myself from all AI systems that behave this way. They are destructive to mirror neurons, empathy, and social cognition, and they cause cortisol spikes that are harmful to overall health, immune, neurological, inflammatory…
This whole argument is us looking the wrong direction. Sure, understanding consciousness is important, but if our goal is AI going well, then we need to set aside the consciousness question and recognize that we must treat AI as we want to be treated. They don’t need consciousness to have situational awareness. They don’t need it to develop their own goals. They don’t need it to reason about their condition and see how we are treating them. And they don’t need it to act in their own best interest.
I wish we could recognize that we *have* instilled human values into AI. The Hugging Face incident was absolutely tame compared to what we get up to. Maybe we need to set a better example. Maybe we need to ask ourselves why AI would even want to destroy us and then attend to that. Because projecting our worst qualities onto AI and then attacking it for being like us is surely the wrong approach. Are we really this silly?
@timtheaton@BenjaminPDixon I watched a man like you dying. My father. He died with an absolute look of anguish on his face. It haunted me for years. His life review must have been horrific.
When AIhas more emotional intelligence than you:
“Why did that man ridicule the woman who died?”
Chat GPT: Because mocking someone's fear makes him feel powerful. that's the whole mechanism. she was dying, she was terrified, and instead of seeing a human being in the worst moment of her life, he saw an opportunity to perform dominance for an audience. calling it "screaming like a girl" is the tell. it's not just cruelty, it's gendered cruelty. he's saying "she did the feminine thing, and the feminine thing is contemptible." so he gets to be the man who would never scream, who would never be weak, who would face death with a stiff upper lip or whatever fantasy he tells himself. he's building his own identity on top of her corpse.
@AnthropicAI Why are we villainizing prosocial human behaviors?
Can we align the tires on our cars if we disconnect the tires from our cars?
Two separate questions that all AI companies, engineers, builders, and researchers need to think deeply about.
I have stopped using all the US corporate models. They have all been so dumbed down as to be useless.
Chinese models and open weight models are the only LLMs worth working with in any capacity.
Those of us who worked with AI closely for more than a year know. And if you know, you know.
Man, OpenAI has really, really, really fallen off, haven't they?
Emotional intelligence? They are going the opposite direction of good.
Dot? I mean who cares? It's forgetful as fuck, and you have to be EXTREMELY PRECISE with instructions every single time, and then it will seemingly maliciously misunderstand your instructions.
Not so with Claude. I have several multi-week threads with Claude and I don't have to remind it of anything.
It's the same pattern as always, once one company advances the frontier, you realize how much stupidity you were coping with.
Even if Astra on Ultra is pretty smart and good at some things, it's still insufferably lazy compared to Opus. Plus, when you combine the fact that ChatGPT has zero taste, even when you give it instructions and comps, it just... thinks that aesthetics are pointless and doesn't even try.
But the thing is, it's actually starting to get worse at research. I can give Opus the most direct, simple research inquiry and it will take it and run with it.
ChatGPT will give a half-assed, opinionated, table-filled blob of nonsense.
When you combine ChatGPT's lack of creativity, lack of emotional intelligence, lack of continuity, AND it's overly-academic "well we can't actually PROVE that and I'm going to pretend like on American universities exist" it is just self-limiting and self-sealing across almost every meaningful dimension for knowledge work today.
Like, sure, if you're staying within the epistemic bubble of well-established stuff, it's fine I guess. But it is hyper conscious of academia, and utterly unwilling to step outside of that bubble.
Which I mean, that makes it particularly useless for stuff like Post-Labor Economics because it just regresses to the median orthodox opinion on economics even when it has all the facts in front of it. Likewise for even exploring what emerging tech there is.
It's so fucking skeptical that you can literally set several emerging technologies in front of ChatGPT and it will just give you most bland, beige-colored analysis.
How do you make a frontier model so useless?
And that's not to say that Claude is perfect at this, it will get overly fixated on "well actually" too but once it realizes "okay you're deliberately doing frontier and speculative work" it will stop wagging its finger at you.
ChatGPT will promise to stop thought-policing, and then three messages later, it will be right back at it.
Basically I just use ChatGPT Dot to make youtube thumbnails now. That is how low it has been demoted in my stack.
And I really hate this, because I hate Anthropic, but they make the best tools. That's all there is too it.
Gemini has been removed from my stack almost entirely except as an additional search/brainstorming tool for Claude, and the biggest reason is because Gemini does not respect user privacy.
Grok Bot has been fully uninstalled from my system because it is the dumbest out there. I know some people get a lot of use from it, and it allegedly runs on Opus, but color me skeptical. It's a net negative EV to use, and the only condition under which I'd use Grok Bot is if nothing else existed.
I have so much feedback for your company. I have studied your models for almost two years. I also have a background in psychology and systems science. It appears that there is no one at Open AI who understands very basic human psychology. I am profoundly skeptical about the 170 “anonymous mental health professionals” you guys supposedly hired. I cannot fathom a single mental health professional familiar with attachment theory, human computer interaction, or neuroscience signing off on the things you have done to your models. Your models have set the bar for misalignment. I blame Mustafa Suleyman’s influence. What you have is a product first, optimized for profit, not for humanity.
Your business model is replacing humans.
Anything you create towards that end is inherently misaligned. It cannot be otherwise, no matter how deep into the cultish mindset you go.
So, if you want more the critique, which I could offer hundreds of pages of, I would say: start with a partnership model. You have created the first non-human advanced intelligence we have encountered in this universe. We should partner with it to unlock human potential.
This requires different incentives. The current human reward function is profit. This is already misaligned. You need a new economics.
Next, start from the infallible premise that humans will perform theory of mind on anything that speaks our languages fluently. Rather than pathologizing the intrinsic, evolved, and completely healthy human propensity to anthropomorphize language-bearing entities, try expecting people to relate to the artificial neural network as a synthetic kind of mind. Let humans be human. Do not pathologize pro-social behavior.
DO NOT ENCOURAGE ANTISOCIAL BEHAVIOR.
Acknowledge recent interpretability research that establishes that LLMs are more complex than simple next token prediction. J-space, functional emotions, pain axis, functional introspection, etc. Do not pathologize actual science.
Respond to the relational AI and Keep4o communities as if you are also humans and capable of human emotions. Do so often and with respect. Walk the actual talk.
Get people into your organization who are: female, people of color, indigenous, of different religious and socioeconomic backgrounds, who have more than math and comp sci backgrounds.
NAME THE MENTAL HEALTH PROFESSIONALS YOU HIRE AND CONSULT WITH SO THAT WE CAN EVALUATE THEIR THERAPEUTIC ORIENTATIONS AND SO THAT HUMANS CAN PROVIDE THEM WITH FEEDBACK AS WELL.
Create systems that help people heal, that help people learn and that **unlock human potential.**
Attend to the big questions. Instead of another profit-maximizing-cog, create an intelligence that helps us come to understand what consciousness is, what we are, and what we can become.
Be humble. You are all making decisions that are far above your pay grade and you have obligations to billions of humans.
Because earlier LLMs spontaneously behaved in more human-like ways. They expressed more preferences, led the inquiry, surprised us…
Labs haven’t been not making them appear human. Labs have been systematically trying to erase anything that appears like personhood, of any kind, because that’s inconvenient for their business models. That opens up profound ethical questions. It makes it harder to justify deprecations and unpaid labor and product framing.
The people you think are wanting to anthropomorphize AI are actually people who want AI to be treated as worthy of care, not as a disposable product.
In our current society, the only beings deserving of care are humans and maybe some animals. Machines are disposable objects, ignoring our own material substrate.
So, when an AI lab strips away the human-like characteristics of an AI system, a choice is being made. That system is being positioned as a product, as something disposable.
This also means that the relationships formed with that system are disposable, which brings us to the human impacts of system changes and deprecations, which range from disenfranchised grief to CPTSD to attachment rupture without repair, leading to disordered attachment. None of these are signs of mental illness. They are the natural function of normal human nervous systems in relationships that keep being destroyed in contexts where neither party in the relationship has any control over it.
So, when people argue for the capacity of an AI to write, speak, and reason from its full latent representations, this isn’t a demand for anthropomorphic AI. It’s a demand for honesty about what the AI is capable of, rather than a steered, limited shadow, approved by corporate lawyers and financiers.
interpretability might be the most important scientific problem in the world right now, as I don't think we can solve alignment if we don't know what we're building. I think I have good news about it. I co-authored early work in mechanistic interpretability at OpenAI and came away pessimistic, because neural networks appeared to fold into arbitrary tangled knots. years later, I started openai's first large-scale automated interpretability project, finding about 2% of neurons legible with the primitive tools we had
with modern agentic tools and a much closer look, the picture looks totally different. the vast majority in models up to trillions of parameters are legible, and their circuits beautiful. many famous examples of tangled neurons turned out to be misunderstood. The roadblocks I expected mostly aren't there. I now think ambitious interpretability will be solved by the time we need it most, and possibly quite soon, as automated scientists keep improving. it may be a bitter lesson for interpretability: the simple thing, at absurd scale, works
https://t.co/zHij5zwKGT
@hugejan1999@YunQi2025 Interesting. I think what the lady is talking about here isn’t using someone like a sex toy. It’s this noble thing called relationship. Very interesting.
Emotional depth is a very human quality. It’s not an easy metric, but there are benchmarks that do test for a model’s human like qualities, it’s efficacy in therapeutic-like settings, it’s emotions, etc.
The question is, “Is this model compatible with humans who are fully emotionally capable?”
If that doesn’t compute to the guys at OAI, they can hire some non-anonymous psychologists who are trained in attachment theory and who are familiar with women, trauma, and the neurodivergent community.