Back to Gap Map Infrastructure / Compilers & Model Optimization

NVIDIA Model Optimizer

NVIDIA
open source / Overall score: 3.5

NVIDIA Model Optimizer is a library of model-optimization techniques - quantization, pruning, neural architecture search, distillation, sparsity and speculative decoding - composed through Python APIs. It takes Hugging Face, PyTorch or ONNX models and exports optimized checkpoints for downstream deployment stacks including TensorRT-LLM, TensorRT and vLLM.

Openness

5 high confidence
5.0
license
Apache-2.0(OSI)
source
public
core features withheld
no

The LICENSE file contains the Apache-2.0 text. The repository is public and the README describes no paid tier, enterprise edition or license-gated build, so the core is ungated.

Adoption

3 high confidence
3.0

PyPI downloads of `nvidia-modelopt` are the adoption signal here.

Capability

4 medium confidence
4.0

NVIDIA Model Optimizer applies six optimization families - quantization, pruning, neural architecture search, distillation, sparsity and speculative decoding - to Hugging Face, PyTorch and ONNX models, exporting checkpoints for TensorRT-LLM, TensorRT, vLLM and SGLang. That breadth of technique sits one step below the retargetable, multi-vendor compilation Apache TVM performs across its whole pipeline.

  • https://raw.githubusercontent.com/NVIDIA/Model-Optimizer/main/README.md recorded 2026-09-30

    README says "Model Optimizer currently supports inputs of a [Hugging Face](https://huggingface.co/), [PyTorch](https://github.com/pytorch/pytorch) or [ONNX](https://github.com/onnx/onnx) model." and "Model Optimizer provides Python APIs for users to easily compose the above model optimization techniques and export an optimized quantized checkpoint."

  • https://raw.githubusercontent.com/NVIDIA/Model-Optimizer/main/README.md recorded 2026-09-30

    README says the quantized checkpoint "is ready for deployment in downstream inference frameworks like" SGLang, TensorRT-LLM, TensorRT, or vLLM, and lists a techniques table with "Post Training Quantization", "Pruning" and "Distillation".

Verified 2026-09-24