AI Potluck
Infrastructure / Compilers & Model Optimization

NVIDIA Model Optimizer

NVIDIA

NVIDIA Model Optimizer is a library of model-optimization techniques - quantization, pruning, neural architecture search, distillation, sparsity and speculative decoding - composed through Python APIs. It takes Hugging Face, PyTorch or ONNX models and exports optimized checkpoints for downstream deployment stacks including TensorRT-LLM, TensorRT and vLLM.

Verified 2026-08-18 via the GitHub API and the LICENSE body.

Openness

5 high confidence
5.0
license
Apache-2.0(OSI)
source
public
core-gated
ungated

Apache-2.0 license body confirmed. The repository is public and unarchived and builds the whole product, and the README describes no paid tier, enterprise edition or license-gated build beside it, so source is public and the core ungated.

Adoption

3 high confidence
3.0

418,452 PyPI downloads of `nvidia-modelopt` in the trailing 30 days, which lands in the 100K-1M band of the software usage scale, level 3.

Capability

4 medium confidence
4.0

Banded on the category feature matrix as multi-technique optimization toolchain. Placed one band below the apache-tvm anchor, on a matrix that bands on how much of the model-to-hardware transformation pipeline a product performs, over how many inputs and targets.

  • https://github.com/NVIDIA/Model-Optimizer/blob/main/README.md recorded 2026-08-18

    README still documents a library of quantization, pruning, neural architecture search, distillation, speculative decoding and sparsity techniques taking Hugging Face, PyTorch or ONNX inputs and exporting optimized checkpoints for TensorRT-LLM, TensorRT and vLLM.

Verified 2026-08-18