Honestly, ChatGPT and LLMs are pretty much the most powerful tools for persuasion and manipulation ever built. You can tell it you lost your keys or your pet died, and itโll say it's 'so incredibly sorry'...and the wild part is how many people actually believe it's sorry.
In the long run, people getting more and more emotionally attached is inevitable imo, and it doesn't matter how much they tweak its 'personality' or response rules.