Skip to content
SPECIFICTION
Get listed

Pathway Live Data Framework

pathway.com

Free plan APISelf-hosted
Visit pathway.com
Spec score 7.5 #13 of 49 in LLM Application Development Frameworks

What it is

Pathway Live Data Framework is a Python framework for building analytics and AI pipelines across stored data and live streams. One pipeline can handle batch processing or streaming ETL, while Differential Dataflow updates results when events arrive out of order. Its Rust processing engine runs Python with multithreading and multiprocessing. AI tooling covers online machine learning, retrieval-augmented generation pipelines, and vector indexes for current data. Documentation lists more than 350 connectors, including SharePoint, and allows custom connectors. Python and SQL programming APIs are available, along with a REST endpoint for serving queries, answers, and real-time features. Deployments can use Docker or Kubernetes and work with OpenTelemetry. Pathway can preserve computation state for recovery. Community is free, self-hosted, and limited to 8 GB RAM and four cores; Scale is free or paid with a license key.

Spec sheet

Purpose
Pathway is a Python data processing framework for analytics and AI pipelines over data streams, including streaming ETL and RAG pipelines.Read 4 Oct 2026 · pathway.com
Deployment
Pathway supports deployment with Docker or Kubernetes and is compatible with OpenTelemetry.Read 4 Oct 2026 · pathway.com
API
The pricing page lists Python and SQL programming APIs and a REST API endpoint for serving queries, answers, and real-time features.Read 4 Oct 2026 · pathway.com
Integrations
The documentation says Pathway includes 350+ connectors, including SharePoint, and lets users implement their own connectors.Read 4 Oct 2026 · pathway.com
Headquarters
Palo Alto, California, USARead 28 Sep 2026 · pathway.com
AI features
Its LLM tooling includes online ML, RAG pipelines, and vector indexes for working with fresh data.Read 4 Oct 2026 · pathway.com
Batch and streaming
The same pipeline can process static data and live data streams.Read 4 Oct 2026 · pathway.com
Community limits
The Community tier is free under BSL 1.1, self-hosted, and supported up to 8 GB RAM and 4 cores.Read 4 Oct 2026 · pathway.com
Enterprise support
Enterprise features listed include a multi-zone SLA and 24/7 phone support.Read 4 Oct 2026 · pathway.com
Incremental computation
Pathway uses Differential Dataflow to handle out-of-order data points in real time.Read 4 Oct 2026 · pathway.com
License telemetry
The licensing guide says Scale license keys send anonymized product usage data to Pathway via an OpenTelemetry collector.Read 4 Oct 2026 · pathway.com
Persistence
Pathway can save computation state to resume after a failure or pipeline update.Read 4 Oct 2026 · pathway.com
Processing engine
Its Rust engine runs Python code with multithreading and multiprocessing.Read 4 Oct 2026 · pathway.com
Scale limits
The Scale tier is self-hosted, requires a license key, and is supported up to 16 GB RAM and 4 cores; the page says it can be free or paid.Read 4 Oct 2026 · pathway.com
Support response
The pricing page lists ticket-based business support with a one-business-day reply time for paid-tier customers.Read 4 Oct 2026 · pathway.com

Plans and prices

Community Free Up to 8 GB RAM · 4 cores · self-hosted Read 4 Oct 2026 · pathway.com
Scale Free Free or paid, with license key Up to 16 GB RAM · 4 cores · self-hosted Read 4 Oct 2026 · pathway.com
Enterprise Priced on request Enterprise licensing Up to 24 TB RAM · 128 cores × 40 nodes · self-hosted or managed Read 4 Oct 2026 · pathway.com

Every Pathway Live Data Framework plan and price →

Strong points and limits

Strong points

  • Processes batch data and live streams
  • 350+ connectors, including SharePoint
  • Python, SQL, and REST APIs
  • State recovery after failures or updates
  • Docker and Kubernetes deployment

Limits

  • Community limited to 8 GB RAM and four cores
  • Scale requires a license key
  • Scale license sends anonymized usage telemetry

Who it suits

It suits teams building Python or SQL analytics, ETL, or AI pipelines that must combine batch and live data. Self-hosted users can choose Community or Scale limits, while Enterprise supports larger deployments.

Verdict

Pathway combines streaming, batch, and AI pipeline tooling in one framework. Its self-hosted tiers and stated resource limits should be checked against your deployment size and licensing needs.

Where Specifiction places it

Alternatives to Pathway Live Data FrameworkAll alternatives →