Back to Gap Map Model components / Inference code

KoboldCpp

LostRuins
open source / Overall score: 3.0

KoboldCpp runs GGUF language models on a personal computer as a single executable with a built-in web interface for chat, story writing and roleplay. Built on llama.cpp, it runs on CPU or GPU, also generates images, video, speech and music with compatible models, transcribes audio, and exposes KoboldAI-, OpenAI- and Ollama-compatible APIs for other apps.

Openness

5 high confidence
5.0
license
AGPL-3.0 (OSI, KoboldCpp and the bundled KoboldAI Lite UI; bundled GGML, llama.cpp and other components keep their MIT or Apache-2.0 licenses)
source
public (the release executables build from the repository)
core features withheld
no — an individual developer's project with no company or paid version behind it

KoboldCpp and its bundled web interface are AGPL-3.0, and the components it builds on, llama.cpp among them, keep their own permissive licenses. It is one developer's project with no company or paid version behind it, and the release executables build from the public repository.

Adoption

3 low confidence
3.0

KoboldCpp ships as standalone executables on its GitHub releases page rather than as a package, so there is no download count to measure. GitHub stars are the only signal, and a star is not a use.

Capability

3 medium confidence
3.0

KoboldCpp packs local text, image, speech and music generation, an agent and several compatible APIs into one executable for a single machine. It runs llama.cpp underneath and offers none of the multi-GPU or datacenter serving vLLM is built for, so it sits two steps below vLLM.

  • https://raw.githubusercontent.com/LostRuins/koboldcpp/HEAD/README.md recorded 2026-11-12

    The README's feature list covers "Local text generation" of GGUF models, image and video generation, speech-to-text with Whisper, text to speech, music generation, "MCP server support, tool calling, web search, retrieval-augmented generation", endpoints for "KoboldAI, OpenAI, Ollama, A1111/Forge, ComfyUI", and a "Single standalone executable for Windows, Linux or macOS".

Verified 2026-11-12