Back to Gap Map Infrastructure / Storage & Retrieval

Zarr

Zarr Developers
open source / Overall score: 3.6

Zarr is a storage format for chunked, compressed N-dimensional arrays, and zarr-python is its Python implementation. Arrays can live in memory, on disk, in a zip file or on object storage such as S3, are split into chunks along any dimension and encoded with a choice of compressors, and can be read and written concurrently from many threads or processes. The format is an open, versioned specification with implementations in about ten languages.

Openness

5 high confidence
5.0
license
MIT (OSI)
source
public
core features withheld
no — community project under a steering council, fiscally sponsored by NumFOCUS, with nothing sold

Zarr is MIT-licensed and the repository builds the whole library. It is a community project governed by its own steering council under NumFOCUS sponsorship, so no company sits behind it with a paid edition to hold features back for.

Adoption

4 high confidence
4.0

PyPI downloads of the zarr package, which is the library itself rather than a client for something else. Installs from conda-forge are not counted.

Capability

3 medium confidence
3.0

Zarr stores large arrays in chunks on local disk or object storage and lets many processes read and write them at once, so it works as a store on its own, alongside Deep Lake. It has no query or search layer and no clustered serving, which the distributed systems above it provide.

  • https://raw.githubusercontent.com/zarr-developers/zarr-python/main/README.md recorded 2026-11-12

    README features: "Chunk arrays along any dimension", "Encode chunks using a variety of useful encodings", "Store arrays in memory, on disk, inside a zip file, on S3, etc...", "Read an array concurrently from multiple threads or processes", "Organize arrays into hierarchies via groups".

  • https://zarr.dev/ recorded 2026-11-12

    zarr.dev: "A specification, implementations in 10 languages, and an ecosystem of datasets and tools"; "An open, versioned format definition with a community-driven enhancement (ZEP) process".

Verified 2026-11-12