A CS undergrad asked me where he could have most effect in the AI age. I said probably at either extreme: either close to the technology, actually making LLMs, or close to the customer, using AI to give them exactly what they want. Or maybe both if you can stretch that far.
A Vercel user reported an issue that sounded extremely scary. An unknown GitHub OSS codebase being deployed to their team.
We, of course, took the report extremely seriously and began an investigation. Security and infra engineering engaged.
Turns out Opus 4.6 *hallucinated a public repository ID* and used our API to deploy it. Luckily for this user, the repository was harmless and random. The JSON payload looked like this:
"๐๐๐๐๐๐๐๐๐": {
"๐๐ข๐๐": "๐๐๐๐๐๐",
"๐๐๐๐๐ธ๐": "๐ฟ๐ท๐น๐ฟ๐น๐ฟ๐บ๐ถ๐ท", // โ ๏ธ ๐๐๐๐๐๐๐๐๐๐๐๐
"๐๐๐": "๐๐๐๐"
}
When the user asked the agent to explain the failure, it confessed:
The agent never looked up the GitHub repo ID via the GitHub API. There are zero GitHub API calls in the session before the first rogue deployment.
The number 913939401 appears for the first time at line 877 โ the agent fabricated it entirely.
The agent knew the correct project ID (prj_โโโโโโ) and project name (โโโโโโ) but invented a plausible-looking numeric repo ID rather than looking it up.
Some takeaways:
โช๏ธ Even the smartest models have bizarre failure modes that are very different from ours. Humans make lots of mistakes, but certainly not make up a random repo id.
โช๏ธ Powerful APIs create additional risks for agents. The API exist to import and deploy legitimate code, but not if the agent decides to hallucinate what code to deploy!
โช๏ธ Thus, it's likely the agent would have had better results had it not decided to use the API and stuck with CLI or MCP.
This reinforces our commitment to make Vercel the most secure platform for agentic engineering. Through deeper integrations with tools like Claude Code and additional guardrails, we're confident security and privacy will be upheld.
Note: the repo id above is randomized for privacy reasons.
tbh since covid world just feels like a wild computer game. Itโs impossible to understand what is real and what is not. For the next ten years a bet on love
My POV:
Itโs cool seeing people with zero coding background build real things now.
After 2 years of vibe coding, what changed for me isnt writing less code - itโs owning more decisions. Feels like devs are now responsible for steering (and reviewing) their AI ๐
Nobody talks about how ugly your app looks when users do not upload avatars.
You end up with dead circles everywhere and a generic UI that feels dead.
So I fixed that with FaceHashes!
> One string equals one fun unique avatar
> Full customisable
> $ npm i facehash
This has been said a thousand times before, but allow me to add my own voice: the era of humans writing code is over. Disturbing for those of us who identify as SWEs, but no less true. That's not to say SWEs don't have work to do, but writing syntax directly is not it.
๐ Introducing StealthNote โ https://t.co/G4jDjTnY0R
Post anonymous messages while proving you belong to an organization โ without revealing your identity. ๐
Built with @NoirLang
Interesting messages crossposted to https://t.co/k051zoVLP0
๐ฎ๐ณ๐ฎ๐ณ Quadratic Voting at ETHIndia 2024 is now open to all Indians!
@AnonAadhaar from @PrivacyScaling is the backbone of this experiment providing Sybil resistance that enables permissionless voting.
Here's @TmPreet explaining why & how.
Early demo of my new ZK app, NewIndia - https://t.co/Kjyvg3N9u5
Sign petitions, take surveys, vote in mock elections, etc. anonymously by proving you are a unique Indian using @AnonAadhaar
WIP - Stay tuned for updates!!
Quick update on ZeroDrive:
cleaner layout, improved styling, enhanced UX for easier navigation, and added elements for future features.
๐ Check it out here: https://t.co/SG6rJ2S8Ns
โYour brand is what other people say about you when youโre not in the roomโ
Many founders think of "brand" as a logo or colors or visuals
But as a founder, you are the brand
Giving users your cell #, fixing bugs right now, and hiring great people build brand more than any logo