Back to Gap Map Model components / Inference code

Apple Core ML Runtime

Apple
closed / Overall score: 4.5(leading)

Apple Core ML is an on-device inference runtime that executes models across Apple's CPU, GPU, and Neural Engine, shipped as a system framework with iOS, macOS, watchOS, tvOS, and visionOS. It partitions model graphs across the available hardware and runs .mlpackage and .mlmodel files, which the separately distributed coremltools package produces. Apple's own on-device features, including Apple Intelligence, are built on it.

Openness

1 high confidence
1.0
source
closed
license
proprietary(Apple system framework, ships compiled with the OS/SDK, no published source)
self-host
no

Core ML has no public repository. Apple's documentation describes it only as an API surface, such as MLModel, that an app calls into, with no source tree to self-host or fork.

Adoption

5 medium confidence
5.0

Core ML ships as a system framework across iOS, iPadOS, macOS, tvOS, watchOS and visionOS, reaching the full installed base of Apple hardware rather than a discrete set of developers. The adoption figure is Apple's own count of active devices from its earnings calls, which counts hardware rather than actual invocations of Core ML.

Capability

4 medium confidence
4.0

Best in class for on-device and edge inference, with Neural Engine acceleration, quantization and palettization, and broad coverage of converted models, but constrained to Apple silicon and to on-device scale. That places it one tier below the large-scale server engines, of which vLLM holds the top capability score in this category.

Verified 2026-09-23