AI Potluck
Infrastructure / Compilers & Model Optimization

bitsandbytes

bitsandbytes Foundation

bitsandbytes provides k-bit quantization for PyTorch, reducing the memory a model needs for inference and training. Three pieces carry that: 8-bit optimizers using block-wise quantization, the LLM.int8() mixed-precision inference path that isolates outlier features, and the 4-bit NF4 quantization QLoRA fine-tuning is built on.

Verified 2026-08-18 via the GitHub API and the LICENSE body.

Openness

5 high confidence
5.0
license
MIT(OSI)
source
public
core-gated
ungated

MIT license body confirmed. The repository is public and unarchived and builds the whole product, and the README describes no paid tier, enterprise edition or license-gated build beside it, so source is public and the core ungated.

Adoption

4 high confidence
4.0

5,708,239 PyPI downloads of `bitsandbytes` in the trailing 30 days, which lands in the 1M-10M band of the software usage scale, level 4.

Capability

3 medium confidence
3.0

Banded on the category feature matrix as one optimization family, applied broadly. Placed two bands below the apache-tvm anchor, on a matrix that bands on how much of the model-to-hardware transformation pipeline a product performs, over how many inputs and targets.

Verified 2026-08-18