Apache Pinot vs Arroyo
Apache Pinot
pinot.apache.org
Arroyo
arroyo.devSide by side
| Figure | Apache Pinot | Arroyo |
|---|---|---|
| Price from | Free | $5/mo |
| Free plan | Yes | Yes |
| Free trial | — | — |
| Open source | — | Yes |
| Web | Yes | Yes |
| macOS | — | Yes |
| Linux | — | Yes |
| API | Yes | Yes |
| Self-hosted | Yes | Yes |
| Plans published | 1 | 3 |
| Spec score · Stream Analytics Software | 8.2 (#6) | 9.2 (#1) |
| Deployment | The official quick install supports Docker and Kubernetes with Helm. | Arroyo can run as a single binary, Docker container or Kubernetes deployment, with SQLite for local use and Postgres recommended for distributed production. |
| Founded | 2013 | 2022 |
| Purpose | Apache Pinot is a real-time distributed OLAP datastore for low-latency, high-throughput analytics and user-facing workloads. | Arroyo is a distributed stream processing engine for stateful computations on data streams, with sub-second results. |
| Support | The project provides Slack, mailing lists, GitHub Issues, and community meetups for questions and discussion. | The deployment guide invites users rolling out clusters to contact [email protected] or ask questions on Discord. |
Plans
Arroyo
- Arroyo open-sourceFree
- Open-source Arroyo EngineFree
- Cloudflare Workers Paid with Pipelines$5 a month
In their own words
Apache Pinot
Apache Pinot is a free, open-source distributed OLAP datastore for real-time analytics and user-facing workloads. It ingests streaming data from Apache Kafka, Apache Pulsar, and AWS Kinesis, plus batch data from Hadoop, Spark, Amazon S3, Azure ADLS, and Google Cloud Storage. Streaming and batch sources can be combined into one queryable table. Pinot provides SQL through a query editor and REST API, with JDBC, Java, Python, and Golang clients for applications. Project materials advertise P90 query latency in the tens of milliseconds on petabyte-scale data and capacity for hundreds of thousands of concurrent queries per second. Logical namespaces provide multitenancy. Security features include HTTP Basic Authentication, ACLs, TLS, mutual TLS, and row-level security filters in version 1.4.0 and later. Superset, Tableau, and Power BI can connect as BI tools. Official installation guidance covers Docker and Kubernetes with Helm. The self-hosted plan is listed at free.
Arroyo
Arroyo is an open-source distributed engine for processing stateful computations on data streams, with sub-second results. Users build streaming pipelines in analytical SQL, including complex queries, windows and joins. Arroyo supports checkpointing for fault tolerance and recovery, exactly-once processing, and horizontal and vertical rescaling; it says the engine can handle millions of events per second. Its connectors include Kafka, Kinesis, MQTT, MySQL, Postgres, Redis, Delta Lake, HTTP and WebSocket, among others. It reads and writes JSON, Avro, Parquet, text and binary, and includes more than 300 SQL functions. Rust scalar, aggregate and asynchronous user-defined functions can extend SQL. The web UI supports connection management, query development and testing, and pipeline monitoring; pipeline management is also available through a REST API. Single-node clusters are intended for development and testing, while production deployments use a distributed cluster with Arroyo’s scheduler or Kubernetes. It is Apache 2.0 licensed, free at free, and self-hostable.