Back to Gap Map Model components / Inference code

ZML

ZML
open source / Overall score: 3.0

ZML is a production inference stack built in Zig on MLIR and Bazel, compiling models directly for NVIDIA, AMD, Intel, TPU and Trainium so that a workload is not tied to one vendor's accelerator.

Openness

5 medium confidence
5.0
license
Apache-2.0(OSI)
source
public(the published repository is the engine)
core features withheld
no — no enterprise path in the repository root and no paid build of the engine in the README

The LICENSE body is the Apache-2.0 text with the appendix omitted and no appended condition. The repository is public, active and builds the engine itself, with no enterprise or paid tier in the root tree or README.

Adoption

2 low confidence
2.0

The `zml` package on PyPI is an unrelated project called Zero Markup Language, so no package artifact is declared for ZML. GitHub stars are the only adoption signal available as a result.

Capability

4 medium confidence
4.0

ZML sits one tier below vLLM. Its hardware reach is broader than most engines here, but it compiles and executes models rather than providing the batching, paged attention and OpenAI-compatible serving surface that vLLM is rated on.

Verified 2026-09-27