AI Potluck
Product / UX / Telemetry & observability

OpenLIT

OpenLIT

OpenTelemetry-native AI engineering platform covering LLM observability, GPU monitoring, guardrails, evaluations, and prompt management. Integrates with 50+ LLM providers, vector databases, and agent frameworks. Vault for managing API keys. Differentiated by breadth of integrations and GPU-level monitoring. 2.5K GitHub stars.

openlit PyPI v1.42.0 (8 May 2026); OTel GPU Collector 0.0.6 (3 Jun 2026). Confirmed live on GitHub + PyPI June 2026.

Openness

5 high confidence
5.0
license
Apache-2.0(OSI)
source
public
core-gated
ungated

Fully Apache-2.0, OpenTelemetry-native, no feature-gated core; vendor-neutral by design (exports to any OTel backend).

Adoption

2 medium confidence
2.0

~590K openlit PyPI downloads/mo; modest but real. As an OTel auto-instrumentation lib some downloads are CI/transitive, so placed conservatively at level 2 (early adopters). ~2.5k GitHub stars corroborates a smaller community vs Langfuse/MLflow.

Capability

4 high confidence
4.0

Broad feature matrix covering all six recipe dimensions (tracing, prompt mgmt, evals, datasets/annotation-adjacent, cost, OTel+integrations) plus GPU observability; comparable to Langfuse C4. Held at 4 (not 5) as no observability product is a clear frontier-definer over MLflow/Langfuse anchors.

Unchanged since 2026-07-30 (last edited, not re-checked)