Patronus Evaluation Platform

platform

closed(hosted SaaS

source

partial(patronus-py is a client wiring to the hosted API, not the engine)

client-SDKs

open(patronus-py public on GitHub, v0.1.25, but only 7 stars and wires to the hosted API)

The open-source SDK is a thin client to a closed hosted evaluation backend; the core scoring engine and the managed Lynx/Glider evaluators are proprietary and not self-hostable. License text is not displayed on the SDK repo page. Class corrected from open_core on 2026-07-30. In this ladder open_core means an OSI core with functionality withheld for a paid tier, and there is no open core here, only an open periphery. A repo that exists while the runtime does not ship is source:partial, which the ladder scores 2/source_available. The score itself was already 2.

• https://github.com/patronus-ai/patronus-py recorded 2026-06-04

  Python SDK whose remote evaluators 'run remotely on Patronus infrastructure'; v0.1.25 Jan 2026; 7 stars

• https://docs.patronus.ai/docs recorded 2026-06-04

  hosted platform: built-in Lynx/Glider evaluators, experiments, production monitoring, SDK access to cloud service

No disclosed user/customer counts or usage volume found on the docs/homepage this run; open source SDK has only 7 GitHub stars (stars_fallback would cap at hobbyist and is not an honest signal for a hosted platform). Declining to assign a level rather than infer from marketing.

• https://github.com/patronus-ai/patronus-py recorded 2026-06-04

  7 stars on the public SDK (no honest usage figure for the hosted platform)

Solid, broad commercial eval feature set (evaluators + experiments + monitoring + agent eval) but not frontier-defining within the category and the closed backend limits reproducibility. Mid-tier on the feature matrix.

• https://docs.patronus.ai/docs recorded 2026-06-04

  Lynx/Glider evaluators, RAG/agent/NLP/OWASP metrics, experiments, red-teaming, monitoring