AI Potluck
Product / UX / UI & API

Otari

Mozilla AI

An open, self-hosted OpenAI-compatible LLM gateway from Mozilla AI. It puts one endpoint in front of 40+ providers with virtual API keys, budget enforcement, and usage tracking, and ships server-side, model-agnostic tools including sandboxed code execution via a Docker-isolated Python REPL. Built on Mozilla AI's any-llm; a hosted platform (Otari.ai) runs on the same core.

Otari LLM gateway, Apache-2.0, from Mozilla AI; ~63 GitHub stars (July 2026), created April 2026. Built on Mozilla AI's any-llm. Verified live July 2026.

Openness

4 high confidence
4.0
license
Apache-2.0(OSI, core)
source
public
self-host
yes(Docker Compose)
service
hosted Otari.ai platform on the same core

Apache-2.0 self-hostable gateway (github.com/mozilla-ai/otari) with a hosted Otari.ai platform on the same core; classed open_core alongside peer gateways such as LiteLLM. Would be open_source (5) if the hosted platform is not a commercial tier.

Adoption

1 low confidence
1.0

63 GitHub stars / 6 forks (July 2026), created April 2026. Very new; limited adoption signal so far. (Mozilla AI's underlying any-llm library is far more adopted at ~2.1K stars, but is a separate product.)

Capability

3 medium confidence
3.0

OpenAI-compatible gateway to 40+ providers with virtual keys, budgets, usage tracking, and sandboxed server-side code-execution tools. Solid feature set, but narrower provider coverage and less proven than LiteLLM (140+ providers). No standard benchmark applies to a gateway.

Unchanged since 2026-07-01 (last edited, not re-checked)