Pravega
pravega.io
What it is
Pravega is an open-source, self-hosted storage system built around durable append-only streams for continuous, unbounded data. Streams hold parallel byte sequences, can scale as ingestion changes, and use automatic tiering to scale-out storage. Data may be retained indefinitely, allowing applications to read current and historical events. Pravega describes exactly-once delivery and processing with ordering guarantees despite client, server, or network failures, and transactions can write event sets atomically. It targets streaming applications, IoT data, and batch or interactive analytics. Connectors are listed for Apache Flink, Spark, Hadoop, Presto, Boomi, and Apache NiFi; client languages include Java, Rust, and Python. Deployment options include a single-process standalone server or distributed mode with Docker Compose. Distributed production deployments list Java 11, supported long-term storage, ZooKeeper 3.6.3, and BookKeeper 4.14.1. TLS and role-based access control are configurable.
Spec sheet
- What it does
- Pravega is an open-source storage system that uses streams to store continuous, unbounded data.Read 5 Oct 2026 · pravega.io
- Product
- Pravega is a storage system built around durable, elastic, append-only streams for continuous, unbounded data.Read 5 Oct 2026 · pravega.io
- Deployment
- Pravega offers standalone mode for development and testing and distributed mode for production, including Kubernetes operators and Docker Swarm deployment options.Read 5 Oct 2026 · pravega.io
- Integrations
- The documented connectors include Apache Flink, Apache Spark, Apache Hadoop, Presto, Boomi, and Apache NiFi.Read 5 Oct 2026 · pravega.io
- Security
- Pravega supports TLS encryption for communication channels and role-based access control through pluggable authentication and authorization implementations.Read 5 Oct 2026 · cncf.pravega.io
- Support
- The project directs users to its community Slack and offers GitHub Issues for bug reports.Read 5 Oct 2026 · pravega.io
- License
- Pravega describes itself as 100% open source and community-driven, with components available under the Apache 2 License on GitHub.Read 5 Oct 2026 · pravega.io
- Headquarters
- Seattle, WA, USARead 28 Sep 2026 · pravega.io
- Auto-scaling
- Pravega can automatically adjust individual streams’ parallelism to accommodate changes in data ingestion rate.Read 5 Oct 2026 · pravega.io
- Autoscaling
- Pravega can automatically scale individual data streams as data ingestion rates change.Read 5 Oct 2026 · pravega.io
- Exactly-once
- Pravega describes exactly-once delivery and processing with ordering guarantees despite client, server, or network failures.Read 5 Oct 2026 · pravega.io
- Exactly-once processing
- Pravega describes exactly-once event delivery and processing with ordering guarantees despite client, server, or network failures.Read 5 Oct 2026 · pravega.io
- Production prerequisites
- The deployment guide lists Java 11, and for distributed production deployments it lists AWS S3, Azure Blob Storage, Google Cloud Storage, HDFS or a mounted distributed filesystem, ZooKeeper 3.6.3, and BookKeeper 4.14.1.Read 5 Oct 2026 · pravega.io
- Retention
- Pravega supports retaining stream data according to application needs, with capacity limited by the configured storage cluster or cloud provider.Read 5 Oct 2026 · pravega.io
- Standalone limitation
- In standalone mode, clients access the server through the localhost interface only.Read 5 Oct 2026 · pravega.io
- Stream storage
- A Pravega stream stores unbounded parallel sequences of bytes durably, elastically, and consistently, with automatic tiering to scale-out storage.Read 5 Oct 2026 · pravega.io
- Transactions
- Pravega transactions let a writer atomically append a set of events to a stream when committed.Read 5 Oct 2026 · pravega.io
- Use case
- Pravega is designed for streaming applications that ingest continuous data and need low-latency access to both current and historical data.Read 5 Oct 2026 · pravega.io
- Who it is for
- The FAQ describes Pravega as suited to streaming and real-time application data, IoT data, and batch or interactive analytics on large amounts of data.Read 5 Oct 2026 · pravega.io
Strong points and limits
Strong points
- Durable streams can retain data indefinitely
- Exactly-once delivery and ordering guarantees
- Automatic stream scaling as ingestion changes
- Atomic transactions for event sets
- Connectors for major data-processing systems
Limits
- Standalone clients connect through localhost only
- Distributed production needs several listed prerequisites
- Standalone security settings are off by default
- Self-hosted deployment requires operational management
Who it suits
Pravega suits teams building streaming, IoT, or large-scale analytics systems that need low-latency access to both live and retained events. It is aimed at self-hosted deployments and developers using Java, Rust, or Python.
Verdict
Pravega provides stream-native storage with retention, autoscaling, transactions, and exactly-once guarantees. Its open-source self-hosted model fits engineering teams prepared to supply infrastructure and configure production dependencies.
Where Specifiction places it
- Event Streaming Platforms#18 of 276.9