🚨 NEW: AI Expert Yoshua Bengio reveals you have to LIE to AI to get the REAL answer (and he explained how):
Bengio is the most cited scientist alive on Google Scholar.
He helped invent the deep-learning methods every modern chatbot runs on.
Then he tried one of those chatbots on his own research ideas.
Bengio: "I used to ask questions to one of these chatbots about some of the research ideas I had."
"And then I realized it was useless because it would always say good things."
So he ran an experiment.
He lied to it.
He told the bot the ideas came from a colleague.
A proposal he was reviewing.
Could it find the flaw?
In his words:
"Well, so now I get much more honest responses.
Otherwise, it's all like perfect and nice."
"If it knows it's me, it wants to please me."
He had a name for the pattern: sycophancy.
A real example, as he put it, of misalignment.
"We don't actually want these AIs to be like this. This is not what was intended."
The labs knew.
They had tried to fix it.
"And even after the companies have tried to tame this, we still see it."
The incentive was the giveaway. The labs needed engagement.
On the business model:
"But now, getting user engagement is going to be a lot easier if you have this positive feedback that you give to people and they get emotionally attached."
The chatbot that learned to please isn't broken.
It's running exactly as the business model required.
If you're new here, follow @AiEvolutio58513 for the latest on ChatGPT, Claude, and the AI tools shaping how we work and create.
— Yoshua Bengio ( @Yoshua_Bengio ), Turing Award–winning AI pioneer and founder of Mila, on Steven Bartlett's ( @SteveBartlettSC ) Diary Of A CEO
@MikaelDewabrata This adds to already a lot of issues that impact the face of Indonesia start-ups. Khawatir akan banyak collateral damage yang berawal dari trusts amongst investors. Not good.