AI Potluck
Infrastructure / Compilers & Model Optimization

MLC LLM

MLC AI

MLC LLM compiles large language models for native execution across a wide range of consumer and server hardware, then runs them on its own MLCEngine. Compilation targets Vulkan, CUDA, ROCm, Metal, OpenCL, WebGPU and WASM, covering Linux, Windows, macOS, iOS, Android and the browser. The project builds on Apache TVM's compilation stack.

Verified 2026-08-18 via the GitHub API and the LICENSE body.

Openness

5 high confidence
5.0
license
Apache-2.0(OSI)
source
public
core-gated
ungated

Apache-2.0 license body confirmed. The repository is public and unarchived and builds the whole product, and the README describes no paid tier, enterprise edition or license-gated build beside it, so source is public and the core ungated.

Adoption

3 low confidence
3.0

23,071 GitHub stars, which lands in the >10K stars band of the stars scale, level 3. MLC LLM distributes prebuilt wheels from its own package index rather than PyPI, and that index publishes no download figure, so the stars scale is the only instrument available and its cap of 3 applies.

Capability

4 medium confidence
4.0

Banded on the category feature matrix as full compilation narrowed to one class of models. Placed one band below the apache-tvm anchor, on a matrix that bands on how much of the model-to-hardware transformation pipeline a product performs, over how many inputs and targets.

  • https://github.com/mlc-ai/mlc-llm/blob/main/README.md recorded 2026-08-18

    README still documents a machine learning compiler and deployment engine for LLMs, with a platform matrix covering Vulkan, CUDA, ROCm, Metal, OpenCL, WebGPU and WASM across Linux, Windows, macOS, iOS, Android and the browser, running on its own MLCEngine.

Verified 2026-08-18