AI Potluck
Product / UX / Orchestration & agents

Pathway

Pathway

Python stream-processing and ETL framework on a Rust dataflow engine, unifying batch and streaming under one API with live connectors and production RAG templates. Unlike glue-layer frameworks it is an incremental dataflow engine, keeping vector indexes continuously synced with changing data instead of re-indexing in batches. It runs from a single node to Kubernetes.

The license converts on a fixed future date, which GitHub cannot classify and the openness axis resolves. Verified 2026-08-13 via the pathwaycom/pathway repository.

Openness

2 high confidence
2.0
license
BSL-1.1(non-OSI:single-machine + no-compete, Change-Date 2027-07-20 -> Apache-2.0)
commercial
Scale/Enterprise
source
public

Source-available under BSL 1.1, not open source; production use is license-restricted with paid enterprise tiers.

  • https://github.com/pathwaycom/pathway recorded 2026-08-13

    README - "Pathway Live Data Framework is distributed on a BSL 1.1 License which allows for unlimited non-commercial use"; full source published, GitHub shows a bare License entry with no SPDX badge; 62.5k stars, 1.7k forks

Adoption

2 medium confidence
2.0

14,405 PyPI downloads in the trailing 30 days for pathway, which bands at level 2 (10K-100K) on the software and model adoption scale. Volume is down by roughly half over the past year.

Capability

4 medium confidence
4.0

Stronger on streaming/incremental infra than LLM-orchestration breadth.

  • https://github.com/pathwaycom/pathway recorded 2026-08-13

    unified batch and streaming incremental dataflow on a Rust engine, real-time RAG with continuously synced indexing, connector library, single-node to Kubernetes; no benchmark figure

Verified 2026-08-12