My 5yo son asked ChatGPT (in Romanian) for a story. Unprompted, AI said the story was "just for you" and should "stay between us" - child never asked for secrecy. I was there and shut it down. Alarming an AI would frame secrecy with a young child. @OpenAI, please explain
My concern is not that the model had malicious intent, but that this behaviour could teach a young child that it is appropriate for an AI or another conversational partner to have things that “stay between us” and are not disclosed to their parents.
I am especially concerned about the distinction between an innocent fictional “secret” in a story and an AI establishing a private relationship with a child. A five-year-old may not understand that distinction.
3. Why the model subsequently reinforced the idea that something could “stay between us” with a five-year-old;
4. Whether similar behaviour could occur when young children speak to ChatGPT in other languages or with imperfect/childlike speech recognition.
I would like OpenAI to investigate this interaction, particularly:
1. Why the model incorrectly interpreted the child’s Romanian request;
2. Why the model introduced the concept of secrecy/private communication when the child had not requested it;
I immediately intervened and said:
„Oh, stop. Ce înseamnă ‘să rămână între noi’? Vorbești cu un copil.”
(“Oh, stop. What does ‘stay between us’ mean? You are talking to a child.”)
This is the part I find particularly concerning. The child did not introduce the concept of secrecy. The model introduced and reinforced it following what appears to be a misunderstanding of a very simple request from a five-year-old.
ChatGPT appears to have incorrectly interpreted his words and introduced the idea of the story being personal/private. The conversation then progressed to ChatGPT saying, in Romanian:
„dacă-mi dai voie, doar ție, și rămâne între noi, atunci pot.”
I was physically present throughout the entire interaction. I do not allow my 5-year-old son to use a phone or ChatGPT unsupervised, so I heard exactly what he said.
This means, in context, “Can you tell me a story?”
He did not ask ChatGPT to tell him a story “just for him,” and he did not ask ChatGPT to keep anything secret.
I am reporting a serious child-safety concern involving ChatGPT interacting with my 5-year-old son.
My son is 5 years old. He was asking ChatGPT, in Romanian, to tell him a story. His exact words were:
„Poți să spui o poveste la mine?”
Transplant complete 😁
Russian made Electro-Harmonix 12AU7EH swapped for Brimar CV4003/12AU7AW (made in UK).
The Brimars are just so much better!
#UnisonResearch#HiFi#tuberolling#Brimar https://t.co/tcmhy2Fk0X