Product / UX / UI & API

LiteLLM

Python SDK and proxy server (AI gateway) that exposes a single OpenAI-format API across 100+ LLM providers (Bedrock, Azure, Vertex, Anthropic, Cohere, vLLM, etc.) with cost tracking, fallback routing, virtual keys, and guardrails. Picked as the de facto open API gateway for organizations that need provider-agnostic LLM access with spend controls; ~48k GitHub stars and adopted as enterprise gateway by many AI platform teams.

v1.84.5 (June 4, 2026)

Openness

4 high confidence

4.0

license: MIT(core)
enterprise-dir: LiteLLM-Commercial-License
source: public
core-gated: gated

license:MIT(core);enterprise-dir:LiteLLM-Commercial-License;source:public

https://github.com/BerriAI/litellm/blob/main/LICENSE recorded 2026-06-04
flagship phase-C verification source
https://github.com/BerriAI/litellm recorded 2026-06-04
flagship phase-C verification source
https://www.litellm.ai/ recorded 2026-06-04
flagship phase-C verification source

Adoption

3 high confidence

3.0

Used-by 21.7k dependent repos on GitHub; ~49.2k stars, 1,342 releases. Treated as 100K-1M range on dependent/usage volume; stars not the basis.

https://github.com/BerriAI/litellm recorded 2026-06-04
flagship phase-C verification source

Capability

4 high confidence

4.0

Unified gateway to 140+ LLM providers in OpenAI format with cost tracking, guardrails, load balancing, virtual keys/budgets, logging. No standard benchmark applies to a gateway; rated on breadth of provider coverage and production features.

https://github.com/BerriAI/litellm recorded 2026-06-04
flagship phase-C verification source
https://docs.litellm.ai/ recorded 2026-06-04
flagship phase-C verification source

Unchanged since 2026-07-30 (last edited, not re-checked)