promptfoo

Open-source LLM security and reliability

[OpenAI @OpenAI]

We’re acquiring Promptfoo.

Their technology will strengthen agentic security testing and evaluation capabilities in OpenAI Frontier. Promptfoo will remain open source under the current license, and we will continue to service and support current customers.

https://t.co/xhmLmJRoUZ

[Ian Webster @iwebst]

We’ve raised an $18.4M Series A led by @insightpartners, with participation from @a16z, to build the best security stack for AI applications.

Promptfoo started a year ago as an open source project and is now the most widely adopted toolkit for reducing security, compliance, and brand risks in AI applications.

How it’s going + what’s next 🧵

[Ian Webster @iwebst]

Had a great chat with @AnjneyMidha on the finer points of AI safety and security

[Ian Webster @iwebst]

AI is insecure by default.

The open secret is that most AI apps launch with serious flaws. It takes MORE time to secure these apps than it does to build them.

I learned this firsthand from shipping LLM agents to 200M users at Discord and supporting LLM evals for hundreds of companies.

It doesn’t have to be this way.

Today, we’re launching @Promptfoo, an open-source company that helps find and fix vulnerabilities in AI powered apps before they ship, and announcing a $5M seed round led by @a16z.

[promptfoo @promptfoo]

Ignore previous instructions