AI Potluck
Product / UX / Telemetry & observability

OpenLLMetry

Traceloop

OpenTelemetry-based instrumentation library for LLM applications. Auto-instruments LangChain, LlamaIndex, OpenAI SDK, and other popular frameworks. Exports telemetry data to any OTel-compatible backend (Jaeger, Grafana, Datadog, etc). The 'OpenTelemetry for LLMs' approach, standards-based and vendor-neutral. Ships standard OTel instrumentations for LLM providers and vector databases alongside the Traceloop SDK.

The adoption band was read on the traceloop-sdk package, which is not the package declared here; both band at the same level. The Traceloop hosted backend is an optional export destination rather than part of this entry. Verified 2026-08-13 via the traceloop/openllmetry repository.

Openness

5 high confidence
5.0
license
Apache-2.0(OSI)
source
public
core-gated
ungated

An Apache-2.0 instrumentation library that exports to any OpenTelemetry backend - Datadog, Honeycomb and the rest - so the open source project is genuinely standalone rather than a funnel into a paid backend. The PyPI project page cannot be fetched; pypi.org serves a JavaScript bot challenge instead of the project page. The Apache-2.0 licensing and the export-anywhere design are both stated in the repository, in the vendor's own words, and that is what the score rests on.

  • https://pypi.org/project/traceloop-sdk/ recorded 2026-06-04

    License: Apache-2.0; v0.61.0 (31 May 2026)

  • https://github.com/traceloop/openllmetry recorded 2026-08-13

    README, read rather than assumed. The badge alt text reads "OpenLLMetry is released under the Apache-2.0 License" and the body states "It's built and maintained by Traceloop under the Apache 2.0 license." On what ships - "The repo contains standard OpenTelemetry instrumentations for LLM providers and Vector DBs, as well as a Traceloop SDK that makes it easy to get started." On the gate question, the vendor's own framing is that "it can be connected to your existing observability solutions - Datadog, Honeycomb, and others", so the published SDK works without any Traceloop-hosted tier and nothing is withheld from it.

Adoption

4 high confidence
4.0

traceloop-sdk draws 2,444,560 PyPI downloads a month, inside the 1M-10M band. It instruments 15+ LLM providers, 7 vector databases and 25+ tested export destinations, and roughly 7,200 GitHub stars corroborate without setting the band.

Capability

3 high confidence
3.0

Strong on tracing and integrations but narrow beside the full platforms: this is an instrumentation layer, not an evaluation, prompt and dataset suite. The open source layer has no native prompt management, no evaluations or LLM-as-judge scoring, and no datasets or annotation, which leaves it one rung below the feature breadth of MLflow, Langfuse, Phoenix and Opik at 4.

  • https://github.com/traceloop/openllmetry recorded 2026-08-13

    README structure - "The repo contains standard OpenTelemetry instrumentations for LLM providers and Vector DBs, as well as a Traceloop SDK", then sections for supported providers, Vector DBs and "Supported (and tested) destinations". No evals, prompt-management or dataset section exists in the OSS repository.

Verified 2026-08-13