Back to Gap Map Infrastructure / Compilers & Model Optimization

GPT-QModel

ModelCloud.ai
open source / Overall score: 2.5

GPT-QModel is a quantization toolkit for large language models with hardware-accelerated kernels for NVIDIA CUDA, AMD ROCm, Huawei Ascend NPUs, Intel XPUs and CPUs. Quantized checkpoints load through Hugging Face Transformers, vLLM and SGLang. It continues the GPTQ line of post-training quantization work.

Openness

5 high confidence
5.0
license
Apache-2.0(OSI)
source
public
core features withheld
no

The LICENSE file contains the Apache-2.0 text, and the README describes no paid tier, enterprise edition or license-gated build, so the core is ungated. The optional Swordfish Blackwell kernel sources it vendors are licensed under AGPL-3.0-or-later and are only compiled at runtime through JIT, so they are not part of the default build.

Adoption

2 high confidence
2.0

PyPI downloads of `gptqmodel` are the adoption signal here.

Capability

3 medium confidence
3.0

GPT-QModel applies post-training quantization methods including GPTQ, AWQ, GGUF and FP8, with kernels for five accelerator families and loaders for three serving stacks (Transformers, vLLM and SGLang). That is one optimization family applied broadly across hardware, not the retargetable compilation Apache TVM performs across its whole pipeline.

Verified 2026-09-24