Back to Gap Map Model components / Inference code

llamafile

Mozilla AI
open source / Overall score: 3.0

llamafile packages a large language model and the software to run it into a single cross-platform executable that runs without installation on macOS, Linux, BSD, and Windows. It combines llama.cpp with Cosmopolitan Libc to produce one file that works across operating systems and CPU architectures. Originally a Mozilla Builders project, it is now maintained by Mozilla.ai and ships a companion single-file speech-to-text tool, whisperfile.

Openness

5 high confidence
5.0
license
Apache-2.0(OSI)+MIT(OSI, for llama.cpp/whisper.cpp deltas)
source
public(mozilla-ai/llamafile)
core features withheld
no

llamafile is licensed under Apache-2.0, with MIT covering its llama.cpp and whisper.cpp deltas. The source is public and the core carries no proprietary tier.

Adoption

3 low confidence
3.0

llamafile ships as single-file binaries rather than a package, so there is no download or pull count to measure adoption. GitHub stars are the only available signal, and because a star is not a use, they show attention to a popular local-inference tool without confirming how much it is actually run.

Capability

3 medium confidence
3.0

Optimized for portability and zero-install local inference rather than datacenter serving throughput. GPU acceleration covers Apple Metal, NVIDIA, AMD and Vulkan, with the AMD and Windows paths documented as best-effort, which places it mid-tier among inference engines.

Verified 2026-09-27, except some scores, still awaiting re-confirmation