🦔A researcher invented a fake eye condition called bixonimania, uploaded two obviously fraudulent papers about it to an academic server, and watched major AI systems present it as real medicine within weeks.
The fake papers thanked Starfleet Academy, cited funding from the Professor Sideshow Bob Foundation and the University of Fellowship of the Ring, and stated mid-paper that the entire thing was made up. Google's Gemini told users it was caused by blue light. Perplexity cited its prevalence at one in 90,000 people.
ChatGPT advised users whether their symptoms matched. The fake research was then cited in a peer-reviewed journal that only retracted it after Nature contacted the publisher.
My Take
The researcher made the papers as obviously fake as possible on purpose. The AI systems didn't catch it. Neither did the human researchers who cited it in real journals, which means people are feeding AI-generated references into their work without reading what they're actually citing.
I've covered the FDA using AI for drug review, the NYC hospital CEO ready to replace radiologists, and ChatGPT Health launching this year. All of that is happening in the same environment where a condition funded by a Simpsons character and endorsed by the crew of the Enterprise was being presented as emerging medical consensus. The people making these deployment decisions seem to believe the pipeline from research to AI to patient is more supervised than it actually is. This experiment suggests it isn't supervised much at all.
Hedgie🤗
https://t.co/8Kg8FOrgHW
🚨A FAMILY MEMBER OF THE 10 YEAR OLD GIRL WHO WAS VICTIM OF A SEXUAL ASSAULT HAS BRAVELY TAKEN TO SOCIAL MEDIA TO SPEAK OUT
This video needs to go viral - PLEASE SHARE!
A message from our own @finnwall as we prepare to kick off The Entrepreneur Experience 2023.
Stay in touch with what’s happening by following #EntExp24 here, on Insta and LinkedIn across the next 24 hours.
It’s like Christmas is coming early 🤣😉- the excitement is really building - can’t wait to share the AMAZING companies that are participating this year - some really big names - more coming soon #EntExp24
Final Week of Applications for our 2023 Entrepreneur Experience on Oct 20 & 21 - Unique event for 24 Emerging Entrepreneurs to gain unparalleled peer learning; access, advice & mentoring from 24 business leaders over 24 hours More Info https://t.co/kbIzoQ1Y6e #EntExp24#Startups
@snoxyy14 I’m his Mammy. To everyone there who cheered him, stood for him and came up to him afterwards, you’ll never know how happy you made him. He’s been singing Christy since before he could talk, and Christy has replied to every letter Míceál wrote him. Christy is a living legend.
You too can be in the room w/"so many talented, experienced & passionate entrepreneurs"
2022 Entrepreneur Experience -Applications NOW OPEN #Startups#SMEs#Entrepreneurs#ScalingEntrepreneurs gain unparalleled advice that is authentic, honest & practical https://t.co/UzS8q2IkwC
@kwayga get the opportunity to pitch their food supply chain platform to @EBAN_org angels representing investment networks across the EU, Africa and US during our EBAN Explorer event @UCC @uccgateway @CorkBIC