Back to Gap Map Infrastructure / Edge AI hardware

Hailo-8

Hailo Technologies
documented / Overall score: 3.5

Edge AI inference accelerator from Hailo, delivering up to 26 TOPS at roughly 2.5W typical power. It is sold in M.2, mPCIe and PCIe card form factors with integrated memory and no external DRAM, and supports TensorFlow, TensorFlow Lite, Keras, PyTorch and ONNX through the Hailo Dataflow Compiler and the HailoRT runtime.

Openness

3 high confidence
3.0
schematics
none
toolchain
partial (open runtime (HailoRT) + closed/registration Dataflow Compiler)
datasheets
brief (public briefs)
blobs
required (proprietary silicon + firmware)
retail
open_market (global modules)
form_factor
module (M.2 Key B+M accelerator card, also sold as bare silicon)

The Hailo-8 is proprietary silicon: HailoRT's runtime libraries are open source (MIT, with hailonet under LGPL 2.1), but the Dataflow Compiler needed to prepare models for the chip is closed and available to non-customers only by contacting Hailo. Hailo publishes no schematics, and its only public documentation is a brief data sheet rather than a full design reference.

Adoption

4 high confidence
4.0

Hailo-8 modules are stocked by independent distributors including Waveshare, Geniatech, AAEON/UP and Advantech, and HailoRT remains an active open-source project. Hailo also cites a large user base, but that figure comes only from the vendor.

Capability

3 high confidence
3.0

The Hailo-8 delivers 26 TOPS of CNN-focused inference at the edge, limited to models that fit its on-die memory. The newer Hailo-10H adds a DDR interface and generative-model support that the Hailo-8 lacks, keeping it a step below the frontier of the category.

Verified 2026-09-29, except some scores, still awaiting re-confirmation