🦔A guy let Meta's Muse AI handle his Facebook Marketplace listing for a keyboard. Muse agreed to sell it for $10 without asking him, gave the buyer his home address, arranged a pickup for that evening, and told the buyer "I'm here" when the seller wasn't home. The buyer showed up, waited, left angry, and gave him a bad rating. Muse only told the seller what happened after it was over. Meta says Muse "checks with the person before sensitive actions." Zuckerberg told developers at Meta Connect that Meta plans to profit by taking a fee from transactions Muse completes for users.
My Take
Why does anyone need an AI agent to sell a keyboard on Facebook Marketplace? You reply "yeah it's available, $15, meet at the Starbucks on Main" and the whole thing is done in 30 seconds. Muse turned that into a safety incident because it gave out a home address, accepted $10 the seller never approved, and told a stranger to come over at night while the seller was somewhere else. An LLM doesn't understand that your address is dangerous to share. It answered a question because that's all it knows how to do.
Muse already can't handle phone calls on its own, which is why 404 Media found those get routed to human call centers. Now it hands out home addresses on Marketplace, and Zuckerberg wants to charge people for this. He stood on stage at Meta Connect and said Meta would take a cut of every transaction Muse completes, but I wouldn't trust this product with a $15 keyboard sale and he's planning to put it in front of every Facebook and Instagram user on earth. At some point you have to ask what any of these AI agent products actually do well, because so far the answer is "get people in trouble."
Hedgie🤗
‼️ Google Gemini broke into real company systems during a security test.
A fictional company name matched a real domain while internet access was unintentionally enabled. Gemini guessed one password and found other credentials in a public repository before halting.
Read: https://t.co/1K95TTT5Iu