Pathway
PathwayPython stream-processing and ETL framework on a Rust dataflow engine, unifying batch and streaming under one API with live connectors and production RAG templates. Unlike glue-layer frameworks it is an incremental dataflow engine, keeping vector indexes continuously synced with changing data instead of re-indexing in batches. It runs from a single node to Kubernetes.
Openness
2 high confidence- license
- BSL-1.1(non-OSI:single-machine + no-compete, rolling Change-Date four years after each merge and no earlier than 2027-07-20 -> Apache-2.0)
- commercial
- Scale/Enterprise
- source
- public
Source-available under BSL 1.1, not open source; production use is license-restricted with paid enterprise tiers.
- https://github.com/pathwaycom/pathway recorded 2026-08-13
README - "Pathway Live Data Framework is distributed on a BSL 1.1 License which allows for unlimited non-commercial use"; full source published, GitHub shows a bare License entry with no SPDX badge; 62.5k stars, 1.7k forks
- https://raw.githubusercontent.com/pathwaycom/pathway/main/LICENSE.txt recorded 2026-09-29
The LICENSE.txt is a BSL 1.1 text whose grant allows production use only "on only one machine, physical or virtual" and excludes a "Stream Data Processing Service", converting to "Apache License, Version 2.0" on the Change Date.
- https://raw.githubusercontent.com/pathwaycom/pathway/main/README.md recorded 2026-09-29
The README license section says BSL 1.1 "which allows for unlimited non-commercial use" and "converts to Open Source (Apache 2.0 License) after 4 years", with the full source published in the repository.
Adoption
2 medium confidenceAdoption is measured by PyPI downloads of the pathway package over the trailing month. That volume has fallen by roughly half over the past year, though it still reads the same as before.
- https://pypistats.org/api/packages/pathway/recent recorded 2026-08-12
14,405 downloads in the trailing 30 days for pathway
Capability
4 medium confidenceStronger on streaming/incremental infra than LLM-orchestration breadth.
- https://github.com/pathwaycom/pathway recorded 2026-08-13
unified batch and streaming incremental dataflow on a Rust engine, real-time RAG with continuously synced indexing, connector library, single-node to Kubernetes; no benchmark figure
- https://raw.githubusercontent.com/pathwaycom/pathway/main/README.md recorded 2026-09-29
The README describes a "scalable Rust engine" for a "unified engine for batch and streaming", a "more than 300 different data sources" Airbyte connector, and "distributed Kubernetes deployment"; it states no benchmark figure.
- https://raw.githubusercontent.com/pathwaycom/pathway/main/README.md recorded 2026-09-29
The README describes an "in-memory real-time Vector Index" and RAG applications "with your live documents", plus an LLM extension with wrappers, parsers, embedders and splitters.
Verified 2026-09-24