Azure AI Foundry Observability
Microsoft AzureMicrosoft's GenAI observability product inside Azure AI Foundry (rebranded to Microsoft Foundry in 2026), providing evaluations, distributed tracing, production monitoring, and content-safety logs for LLM apps and agents. Built on OpenTelemetry and integrated with Azure Monitor Application Insights, with built-in evaluators covering quality (coherence, fluency), RAG (groundedness, relevance), safety (hate/unfairness, violence, protected materials), and agent-specific metrics (tool-call accuracy, task completion). Supports tracing for LangChain, LangGraph, OpenAI Agents SDK, and the Microsoft Agent Framework. Evaluations, Monitoring, and Tracing went GA via Foundry Control Plane in 2026, with continuous evaluation and the Agent Monitoring Dashboard in preview; leverages Azure's enterprise footprint as the default observability layer for Azure-hosted GenAI workloads.
Microsoft Foundry (formerly Azure AI Foundry) Observability: evaluations + monitoring + tracing reached general availability March 2026. OpenTelemetry-based tracing via Azure Monitor / Application Insights. Proprietary Azure managed service. Verified live June 2026 in Microsoft Learn docs.
Openness
1 high confidence- license
- proprietary(Azure managed service)
- source
- closed
- note
- tracing built on open OTel standard + Azure Monitor App Insights, but the observability product is proprietary and Azure-locked
Proprietary Microsoft Azure managed offering. OTel is the wire standard (trace data is portable) but the service itself is closed.
- https://learn.microsoft.com/en-us/azure/foundry/concepts/observability recorded 2026-06-04
Microsoft Foundry observability (eval/monitoring/tracing) as a managed Azure service built on OpenTelemetry + Azure Monitor
Adoption
3 low confidenceGA March 2026 as a feature surface within Microsoft Foundry on Azure; no standalone usage figures published for the observability capability specifically. Level 3 reflects availability inside a large cloud AI platform, not a measured user count; directional.
- https://learn.microsoft.com/en-us/azure/foundry/concepts/observability recorded 2026-06-04
observability GA (Mar 2026) shipped within the managed Microsoft Foundry platform
Capability
3 medium confidenceThree pillars (eval/monitoring/tracing) with strong OTel + framework coverage, but matrix breadth on prompt versioning/datasets/annotation is thinner than the dedicated OSS platforms; scored 3 below the C4 anchors.
- https://learn.microsoft.com/en-us/azure/foundry/concepts/observability recorded 2026-06-04
OTel tracing, monitoring, evaluations; auto-instrumentation for Semantic Kernel/LangChain/LangGraph/OpenAI Agents SDK
Unchanged since 2026-06-09 (last edited, not re-checked)