AI Potluck
Product / UX / Telemetry & observability

Datadog LLM Observability

Datadog

Enterprise LLM monitoring integrated into the Datadog APM platform. Traces LLM calls alongside existing infrastructure, application, and security monitoring. For organizations already using Datadog who want unified observability across their entire stack including AI/LLM components. Covers agent monitoring, prompt tracking and management, quality monitoring, and correlation of LLM spans with APM.

Datadog publishes no usage figure for this module, so its adoption band stands on the reach of the Datadog platform rather than on a measurement of the module. Verified 2026-08-13 via the Datadog LLM Observability documentation.

Openness

1 high confidence
1.0
license
Proprietary
source
closed
platform
proprietary SaaS(no source)

Closed proprietary SaaS; only Datadog's tracing client libraries are open, the LLM Observability product and backend are closed.

  • https://docs.datadoghq.com/llm_observability/ recorded 2026-08-13

    LLM Observability documentation, sitting inside the wider Datadog docs alongside APM, Log Management and Cloud SIEM. The navigation covers Agent Monitoring, MCP Clients, Prompt Tracking, Prompt Management, Quality Monitoring and correlation with APM. Nothing on the page links a source repository or a self-hosted distribution of the product itself.

Adoption

4 low confidence
4.0

LLM Observability rides the large installed base of Datadog APM, a major enterprise observability vendor, but it is a newer add-on with no disclosed standalone user or usage count of any kind in the docs. The level is therefore attributed to the parent platform and is directional: what is banded is the reach of Datadog overall, not usage of the LLM Observability module.

  • https://docs.datadoghq.com/llm_observability/ recorded 2026-08-13

    The module's documentation, read for a usage figure and containing none - no customer count, no account count, no ingested-span volume. It sits inside the Datadog docs beside APM, Log Management, Cloud SIEM and the rest of the platform, which is the only thing on the page that speaks to reach.

Capability

4 medium confidence
4.0

A broad enterprise-grade feature matrix: end-to-end trace capture of tokens, errors, latency and workflows; built-in and custom evaluations; cost, latency and usage dashboards; sensitive-data scanning, redaction and prompt-injection detection; topic clustering; anomaly detection; and auto-instrumented framework integrations for OpenAI, LangChain, Bedrock and Anthropic, all integrated with the wider Datadog APM suite. That is level with Langfuse at 4. The product is closed, but capability is scored independently of openness.

  • https://docs.datadoghq.com/llm_observability/ recorded 2026-08-13

    Documentation navigation for the module - Quality Monitoring, Jobs Monitoring, Agent Monitoring, MCP Clients, Prompt Tracking, Prompt Management, "Querying spans and traces", "Correlate with APM" and Patterns - plus Sensitive Data Scanner and Watchdog Insights on the wider platform.

Verified 2026-08-13