Model components / Evaluation code

promptfoo

promptfoo v0.121.14 (Jun 2 2026). CLI + library for LLM eval and red-teaming; now part of OpenAI but remains MIT-licensed open source. Confirmed live June 2026.

Openness

5 high confidence

5.0

license: MIT(OSI)
source: public(GitHub)
core-gated: ungated

MIT-licensed, fully public; OSI -> open_source. OpenAI ownership noted but does not change the OSS license at scoring time.

https://github.com/promptfoo/promptfoo recorded 2026-06-04
MIT license; 'remains open source and MIT licensed' under OpenAI; v0.121.14

Adoption

4 high confidence

4.0

~1.18M npm downloads/mo (May 4-Jun 2 2026); 21.9k stars; project states it powers LLM apps serving 10M+ users in production. Headline = npm registry primary source; 1-10M band.

https://api.npmjs.org/downloads/point/last-month/promptfoo recorded 2026-06-04
1,176,340 monthly npm downloads
https://github.com/promptfoo/promptfoo recorded 2026-06-04
21.9k stars; '10M+ users in production' claim

Capability

4 high confidence

4.0

Very broad eval coverage plus a distinctive red-teaming/security axis; top-tier for application eval, below the academic-benchmark standardization references on raw benchmark coverage.

https://github.com/promptfoo/promptfoo recorded 2026-06-04
eval + red-teaming + model comparison + CI/CD features

Unchanged since 2026-07-30 (last edited, not re-checked)