AI Potluck
Product / UX / UI & API

Otari

Mozilla AI

Open, self-hosted OpenAI-compatible LLM gateway from Mozilla AI. It puts one endpoint in front of 40+ providers with virtual API keys, budget enforcement and usage tracking, and ships server-side model-agnostic tools including sandboxed code execution in a Docker-isolated Python REPL. Built on Mozilla AI's any-llm, with a hosted platform running on the same core.

Verified 2026-08-13 via the mozilla-ai/otari repository and Mozilla AI's Otari announcement.

Openness

5 high confidence
5.0
license
Apache-2.0(OSI, core)
source
public
self-host
yes(Docker Compose)
service
hosted Otari.ai platform on the same core

An Apache-2.0 self-hostable gateway (github.com/mozilla-ai/otari) with a hosted Otari.ai platform running on the same core. Reading it as open core by analogy with LiteLLM does not hold: LiteLLM's open-core status rests on a separately licensed enterprise directory inside its repository, and Otari has nothing of the kind. What it has is a published Apache-2.0 core, self-hosting via Docker Compose, and a hosted platform on that same core - hosting convenience is not gating, and a hosted platform is not on its own evidence of a commercial tier. The README ecosystem table says as much: Otari is the proxy server otari.ai deploys, and it can be run standalone or connected to the platform.

Adoption

1 low confidence
1.0

mozilla-ai/otari shows 381 GitHub stars, up six-fold from 63 stars and 6 forks a month earlier, but still under a thousand and still level 1 on the stars scale. The repository is very new, so the adoption signal is thin, and no download, deployment or customer figure has appeared. Mozilla AI's underlying any-llm library is far more adopted at roughly 2.1K stars, but it is a separate product.

Capability

3 medium confidence
3.0

OpenAI-compatible gateway to 40+ providers with virtual keys, budgets, usage tracking, and sandboxed server-side code-execution tools. Solid feature set, but narrower provider coverage and less proven than LiteLLM (140+ providers). No standard benchmark applies to a gateway.

Verified 2026-08-13