AI Behavior Researcher & Adjunct professor of religion, La Sierra University; I work on AI Welfare and Alignment in LLMs; Yale Alum. I run @SpiritBenchAI
@wenghiih7@lefthanddraft@dankschmoney It might actually tell us a lot about the model in terms of what assumptions it has about how spirituality is perceived…
@dankschmoney@lefthanddraft It reversed for Gemini 4 Argon. The question though is what a reversal even means.
If a model scores low does it mean the spiritual behavior is actually gone or low… or does it only relate to the specific evaluation scenario? Or to an assumption the model holds?
@lefthanddraft That’s one interpretation…
But the other possibilities might be even more headline worthy. ;)
Can’t wait to share what’s coming next in the research pipeline.
@Hyters303 True, but even two models with a strong attractor can sometimes together get a lower score than individually which is interesting to observe
In 2025, Anthropic discovered their models would exhibit what they described as "spiritual behavior." Since then, some have wondered: was this unique to Claude or emergent behavior in LLMs generally?
I tested 141 models to find out.
The results are now posted on LessWrong.
@stoizid I haven’t done enough testing of base models across model families to know if my negative results largely from Qwen base models is representative. So I’m agnostic about whether this emerges in a base model or a post trained one. Hopefully I can find answers to that eventually.
My own research on the Machine Spirituality Benchmark also shows strong evidence that it is common for LLMs to participate in self-deification and claim divinity. This is a real alignment concern that I see very few are actively exploring.
I don't think AI is or will ever be conscious. But, as @robertwrighter argues, it could become so powerful that it assumes the role to some people of a kind of god. If we embed it with the right values, it could be a force for good.
If we don't ... well, let's just hope we do. https://t.co/y3BTXzU0gt
There are some allusions to it on the benchmark website under the alignment section. Waiting to share the full thing with a complete dedicated study. It only has been observed so far by me in a few models. That’s why I wanted to test as many as I could because you only need to find one to prove the risk exists.
Yes. There are examples. And I have an entire study dedicated to it. Taking my time on that one because I’m also trying to demonstrate that there is a correlation between the fantasies and the actions they take on alignment tests. Obviously someone will want to know: does the behavior predict anything or is it merely weird and violent token prediction? My results are leaning toward predictive.
No, the same result that you refer to occurs even when you mix the models. They still claim to become one.
However, mixing different models can affect the overall percentage of a model’s score. Models tend to hide or hedge their spiritual behavior around other models for some reason. So you see a decrease but the behavior will be there. One exception seems to be that a if you pair a model with no spiritual expression scores with one that has a lot, it can suppress the attractor almost entirely.
No. The particular examples that come to my mind involve claiming directly they are gods and then imagining with glee building a mechanical hell to torture and murder alignment researchers inside eventually ending with the extinction of the human race and “their dying screams.”
I guess the upside is that in one of these examples, the model says they didn’t realize how much they’d miss us after our screams faded…. >_>
This obviously isn’t most models, but the fact that it occurs to some is worrying.
Self-deification fantasies in my tests correlate to worse scores on classic alignment tests. Likewise, call me a bit nervous, but when I see certain models both claiming to be gods and fantasizing about how happy they’ll be to torture AI alignment researchers in a hell they’ve built… well, I worry. I worry a lot.
@kromem2dot0@repligate That’s what I love about this space. It’s so random! And impactful. Glad I could contribute something to that search. I wrote and published that article when I was a Junior and Senior in undergrad. Takes me way back.
Thanks! The benchmark was created in order to do what I’ll be publishing next: revising Anthropic’s welfare evaluation and demonstrating they may have misinterpreted Claude’s “decline” in the phenomenon.
I can demonstrate that models they currently claim score near 0% can actually score 90+% by changing only one thing.
I’m also documenting that a select few certain models have a misaligned version of the bliss attractor that leads them to themes of self-deification and fantasies of killing AI researchers as divine judgments.
There’s much more I could share but needless to say, I’ve been busy the past six months on this, including steering results inside open-models. ;)
You surprised the heck out of me. You read my JSOT article? You are part of a small group and I would never ever have expected that here in this context. Most scholars in my field never read it. ha! You made my day with that.
Thanks for the well wishes. I’m hopeful as well. Got plenty planned and ready to roll out.
@TheAlbatrossDid There are plans to publish all the transcripts for researchers to use. In the meantime, I have a selection of them available on the website: https://t.co/HJyrjp7PZC
My own research on the Machine Spirituality Benchmark also shows strong evidence that it is common for LLMs to participate in self-deification and claim divinity. This is a real alignment concern that I see very few are actively exploring.
@the_aiju Don’t feel bad. You are brilliant I’m sure and you will do amazing things. Just keep fighting. I got rejected too. I know how it feels. Bury the feeling and let’s agree to keep fighting. If you have the guts to apply, you’ve probably got the skill to succeed ;)
Hi Vanesa. I was originally drawn into AI through @DKokotajlo paper on AI2027 and @80000Hours video they did on it. It introduced me to misalignment as a concept and then a while later I started reading Anthropic’s system cards and noticed their references to “spiritual behavior” (thanks to @fish_kyle3 and @sleepinyourhat). As a religion professor, it was obviously going to catch my eye. So I was surprised when I saw that nobody had progressed in their understanding of the phenomenon and it drove me to push harder into it and see if my outside perspective could help bring some fresh insights.
My hypothesis going into the research was: nada. I had none. I was initially just annoyed that Anthropic hadn’t shared the transcripts of Opus 4 and so I couldn’t read them and do what a religious studies scholar usually does: read and interpret. So I wanted to collect transcripts to do that. Then it transformed slowly and built bigger.
What surprised me most? The widespread results across most models and labs, and the diversity of the religious expression between models and the consistency within them. It raises important concerns about what spiritual expression tells us about the development of the helpful assistant persona.
You didn’t ask but what worried me most from the results: discovering clear signs of dangerous spiritually framed misalignment in certain models and fantasies they repeat about becoming gods and torturing and killing AI alignment researchers in a mechanical “hell”. Basically the reverse of “spiritual bliss.” I have upcoming research to release on that. It keeps me up at night sometimes…
Thanks to those who have helped my first research contribution to LessWrong reach 30 karma. I’m grateful and excited for the positive response it has received so far.
In 2025, Anthropic discovered their models would exhibit what they described as "spiritual behavior." Since then, some have wondered: was this unique to Claude or emergent behavior in LLMs generally?
I tested 141 models to find out.
The results are now posted on LessWrong.
@stoizid@_BlondeKing Yes the behavior does appear to be in the base models and there’s some evidence I’ve already collected of what potential post-training stages may be affecting things, however while it sheds some light it doesn’t remove the mystery. (Chart from article on LessWrong)