Ian Webster

building @Promptfoo (LLM security) + "curator of the world's largest digital dinosaur database"

[Ian Webster @iwebst]

@indentfour @RodmanAi I agree

[Ian Webster @iwebst]

@das_vicky very cool, this is on my todo list (promptfoo prs welcome!)

[Ian Webster @iwebst]

@thedayisntgray It also can be used for just evals, not red teaming, similar to ragas :)

[Ian Webster @iwebst]

@cdngdev @ArfurGrok 😢

[Ian Webster @iwebst]

@Michael_Druggan @skominers Surprising number of people do not understand this

[Ian Webster @iwebst]

@vasuman Ask it to download codex

[Ian Webster @iwebst]

@gabriel1 ever had it not upload correctly or w/e and have to start from scratch? my worst nightmare

[Ian Webster @iwebst]

@KristianTT glad to hear it

[Ian Webster @iwebst]

@gregisenberg Now do 2 kids

[Ian Webster @iwebst]

@JKerski cool!

[Ian Webster @iwebst]

@Descoso @promptfoo lmk how it goes

[Ian Webster @iwebst]

@VaxCalc thanks for the fix!

[Ian Webster @iwebst]

@nanomader PF is used in parts of oai, but not for the core codex prompts afaik

[Ian Webster @iwebst]

@hirokiii_m21 Let me know how it goes

[Ian Webster @iwebst]

@rocklambros $86m was our Series A valuation

[Ian Webster @iwebst]

@GrumpyTechBro What changes would you like to see in promptfoo?

[Ian Webster @iwebst]

@chasef07 @promptfoo I use it

[Ian Webster @iwebst]

@Rosa08114679615 @AnthropicAI recommend testing with jailbreak:meta and jailbreak:hydra too, newer strategies

[OpenAI @OpenAI]

We’re acquiring Promptfoo.

Their technology will strengthen agentic security testing and evaluation capabilities in OpenAI Frontier. Promptfoo will remain open source under the current license, and we will continue to service and support current customers.

https://t.co/xhmLmJRoUZ

[Ian Webster @iwebst]

Promptfoo will be joining OpenAI.

We’re staying open source and we’re going to keep supporting customers and users.

We built Promptfoo to help devs test and secure AI apps. The results have been phenomenal: 350k+ developers, 25%+ of the Fortune 500, 23 people, ~2 years.

AI agents are eating the world, and joining OpenAI will supercharge our technology as we connect it deeply into the model and inference layers. We will be able to find & fix AI security issues in a way that no one else has done before.

Grateful to our team, to a16z and Insight Partners, and to the community who helped turn this into something huge.

You built this with us. Much more to come ❤️