AI Potluck
Infrastructure / Core ML frameworks & libraries

GGML

ggml-org (Georgi Gerganov)

GGML is a low-level C tensor library for machine learning with no third-party dependencies, zero runtime memory allocations, integer quantization support, automatic differentiation, and optimizers. It runs cross-platform and is the tensor backend behind llama.cpp and whisper.cpp. It is maintained by ggml.ai / Georgi Gerganov; much active development now occurs in the dependent llama.cpp and whisper.cpp repos.

Verified live 2026-06-22 via primary sources. MIT license body confirmed (Copyright 2023-2026 The ggml authors); full source public.

Openness

5 high confidence
5.0
license
MIT(OSI)
source
public
core-gated
ungated

MIT license body confirmed (Copyright 2023-2026 The ggml authors); full source public.

Adoption

3 medium confidence
3.0

No PyPI package; GitHub shows ~14.9k stars (and underpins much higher-adoption llama.cpp).

Capability

5 high confidence
5.0

Foundational low-level runtime enabling efficient on-device LLM/ASR inference.

Unchanged since 2026-07-30 (last edited, not re-checked)