AI Potluck
Infrastructure / Core ML frameworks & libraries

GGML

ggml-org (Georgi Gerganov)

GGML is a low-level C tensor library for machine learning with no third-party dependencies, zero runtime memory allocations, integer quantization support, automatic differentiation, and optimizers. It runs cross-platform and is the tensor backend behind llama.cpp and whisper.cpp. It is maintained by ggml.ai / Georgi Gerganov; much active development now occurs in the dependent llama.cpp and whisper.cpp repos.

Verified 2026-08-13 via GitHub and the LICENSE body.

Openness

5 high confidence
5.0
license
MIT(OSI)
source
public
core-gated
ungated

MIT license body confirmed (Copyright 2023-2026 The ggml authors); full source public. The repository is public and unarchived, and the README describes the whole library with no paid, enterprise or hosted tier beside it, so source is public and the core ungated.

Adoption

3 medium confidence
3.0

ggml publishes no package of its own - it is vendored as source into llama.cpp and whisper.cpp - so GitHub stars are the only signal available, which keeps the level directional and capped at 3. The GitHub API reports 15,159 stargazers on ggml-org/ggml, which falls in the over-10K stars band, level 3 on the stars scale. Stars are banded on their own scale rather than the download one, because a star is not a download.

Capability

5 high confidence
5.0

Foundational low-level runtime enabling efficient on-device LLM/ASR inference.

  • https://github.com/ggml-org/ggml recorded 2026-08-13

    README still describes a dependency-free C tensor library with integer quantization, autodiff and optimizers, backing llama.cpp and whisper.cpp

Verified 2026-08-13