AI Potluck
Model components / Inference code

ZML

ZML

ZML is a production inference stack built in Zig on MLIR and Bazel, compiling models directly for NVIDIA, AMD, Intel, TPU and Trainium so that a workload is not tied to one vendor's accelerator.

The `zml` package on PyPI is an unrelated project, so no package artifact is declared. Verified 2026-08-31 via GitHub, the LICENSE body and the repository README.

Openness

5 medium confidence
5.0
license
Apache-2.0(OSI)
source
public(the published repository is the engine)
core-gated
ungated(no enterprise path in the repository root and no paid build of the engine in the README)

The LICENSE body is the Apache-2.0 text with the APPENDIX omitted and no appended condition, read in full rather than taken from the API's label. The repository is public and unarchived and builds the engine itself. Its root tree carries no enterprise, ee or commercial directory and its README describes no licence-gated build, so the core reads as ungated. Confidence is medium because that is a repository-and-README read rather than a pricing-page read.

Adoption

2 low confidence
2.0

4,011 GitHub stars, in the 1K-10K band of the stars scale. The `zml` package on PyPI is an unrelated project called zero markup language, so no package artifact is declared and stars are the only instrument available.

Capability

4 medium confidence
4.0

One band below the vllm anchor. Its hardware reach is broader than most engines here, but it compiles and executes models rather than providing the batching, paged-attention and OpenAI-compatible serving surface the anchor is banded on.

Verified 2026-08-31