Open-source CLI and library for evaluating and red-teaming LLM applications with automated testing, security vulnerability scanning, and CI/CD integration. Recently acquired by OpenAI but remains open-source.
Promptfoo is a CLI and library for evaluating and red-teaming LLM applications. As of March 16, 2026, Promptfoo joined OpenAI while remaining open-source under the MIT license.
The goal: test-driven LLM development, not trial-and-error. Simple, declarative test cases enable automation without heavy notebooks or extensive coding.
Use assertions to compare LLM output against expected values or conditions. Validate output through:
Free and open-source under MIT license.
Loading more......