Back to Gap Map Product / UX / Telemetry & observability

Galileo

closed / Overall score: 3.5

Galileo, now called Splunk Agent Observability, is an AI observability and reliability platform that combines offline evaluation, online production guardrails and tracing. Its Luna-2 small judge models detect hallucinations, tool errors and policy violations, and the vendor says customized evaluations can monitor all production traffic at a fraction of the cost of a large judge model. It deploys as SaaS, into a customer VPC, or on-premises.

Openness

1 high confidence

1.0

license: proprietary
source: closed
deploy: SaaS/VPC/on-prem(managed)

A proprietary platform with no OSI-licensed core product, so it scores as closed.

https://docs.galileo.ai/ recorded 2026-09-29
Docs home: "As of August 7, 2026, Galileo is now Splunk Agent Observability." and the platform is described as "the leading observability, evaluation, and guardrail platform for GenAI and agentic applications". Searched the body for open source and license: none.
https://galileo.ai/ recorded 2026-09-29
Homepage: the platform is described as "Cloud / SaaS / On-Premises" and "Trusted by leading enterprises to measure, protect, and improve AI in production." Searched the body for open source, GitHub, self-host and license: no source repository or open license for the platform is offered.
https://galileo.ai/pricing recorded 2026-09-29
Pricing page: "Deploy: Hosted, VPC, or on-prem" for the managed platform. Searched the body for open source, self-host and license: none.

Adoption

3 low confidence

3.0

Galileo's homepage says it is trusted by leading enterprises but names no customers and discloses no user or usage figures. That is an unquantified vendor claim, so it says little about how widely the platform is used.

https://galileo.ai/ recorded 2026-09-29
Homepage: "Trusted by enterprises, loved by developers" and "Trusted by leading enterprises to measure, protect, and improve AI in production." Searched the body for a customer count or user count: none.

Capability

4 medium confidence

4.0

Galileo pairs agent-behavior tracing, which the docs extend to distributed tracing with OpenTelemetry, with more than twenty out-of-the-box evaluations, production guardrails, and cost optimization through its own Luna-2 judge models. Its loop from offline evaluation to runtime guardrail intervention is a distinguishing feature, but the feature set matches Langfuse's rather than exceeding it.

https://docs.galileo.ai/ recorded 2026-09-29
Docs navigation lists "Distributed Tracing with OpenTelemetry", "Luna-2" and "Out-of-the-Box Metrics", and states "Galileo is now Splunk Agent Observability" as of August 7, 2026.
https://galileo.ai/ recorded 2026-09-29
Homepage: "Start with 20+ out-of-box evals for RAG, agents, safety, and security" and "Distill your optimized evals into Luna models that monitor 100% of your traffic at 96% lower cost." plus the eval-to-guardrail framing "Go from evals to guardrails".

Verified 2026-09-29