Apache Iceberg
iceberg.apache.org
What it is
Apache Iceberg is a free, open-source table format for analytic datasets, including very large analytic tables. It is self-hosted and works through APIs on Linux, macOS, and Windows, using storage you provide. Engines such as Spark, Trino, Flink, Presto, Hive, and Impala can use the same tables. SQL commands support merging new data, updating rows, and targeted deletes. Columns can be added, renamed, or reordered without rewriting a table. Hidden partitioning creates partition values and skips unnecessary partitions and files. Table snapshots can be queried by version or timestamp, and tables can be rolled back. Atomic updates, serializable isolation, consistent snapshot reads, and optimistic concurrency support multiple writers. Integrations include Kafka Connect and catalogs such as AWS Glue, JDBC, and Nessie. Encryption supports AWS, Azure, or GCP KMS clients, including custom clients. Version 1.12.0 removes Spark 3.4 and Flink 2.0 support. The Apache License 2.0 applies.
Spec sheet
- Purpose
- Apache Iceberg is an open table format for analytic datasets and a high-performance format for huge analytic tables.Read 7 Oct 2026 · iceberg.apache.org
- Integrations
- The documentation lists integrations including Kafka Connect, AWS Glue, AWS S3, Dell ECS, JDBC, and Nessie.Read 7 Oct 2026 · iceberg.apache.org
- Support
- The project community page lists public mailing lists, including user and developer lists.Read 7 Oct 2026 · iceberg.apache.org
- License
- The site identifies Apache License 2.0 as the license for Apache Iceberg.Read 7 Oct 2026 · iceberg.apache.org
- Community support
- The project provides community discussions through its dev mailing list and an Apache Iceberg Slack workspace.Read 7 Oct 2026 · iceberg.apache.org
- Compaction
- Data files can be rewritten using strategies such as bin-packing or sorting.Read 7 Oct 2026 · iceberg.apache.org
- Concurrent writes
- Iceberg supports multiple concurrent writes using optimistic concurrency, with failed commits retried against the new current table state.Read 7 Oct 2026 · iceberg.apache.org
- Downloads
- The downloads page lists source archives and runtime JARs for Spark and Flink, along with AWS, GCP, and Azure bundles.Read 7 Oct 2026 · iceberg.apache.org
- Encryption
- Table encryption can use predefined AWS, Azure, or GCP KMS clients, or a custom KMS client.Read 7 Oct 2026 · iceberg.apache.org
- Engine compatibility
- The project says engines including Spark, Trino, Flink, Presto, Hive, and Impala can work with the same tables at the same time.Read 7 Oct 2026 · iceberg.apache.org
- Engines
- The site lists Spark, Trino, Flink, Presto, Hive, and Impala as engines that can work with Iceberg tables.Read 7 Oct 2026 · iceberg.apache.org
- Notable compatibility limit
- Version 1.12.0 removes Spark 3.4 and Flink 2.0 support.Read 7 Oct 2026 · iceberg.apache.org
- Partitioning
- Hidden partitioning lets Iceberg produce partition values and skip unnecessary partitions and files automatically.Read 7 Oct 2026 · iceberg.apache.org
- Release and limits
- The latest listed release is 1.12.0, and its release notes say Spark 3.4 and Flink 2.0 support were removed.Read 7 Oct 2026 · iceberg.apache.org
- Reliability
- The documentation describes atomic table updates, serializable isolation, consistent snapshot reads, and rollback from table history.Read 7 Oct 2026 · iceberg.apache.org
- Schema evolution
- Columns can be added, renamed, and reordered without rewriting the table.Read 7 Oct 2026 · iceberg.apache.org
- Security requirement
- Catalogs must preserve the table's encryption key ID property throughout the table's lifetime.Read 7 Oct 2026 · iceberg.apache.org
- SQL operations
- Iceberg supports SQL commands to merge new data, update existing rows, and perform targeted deletes.Read 7 Oct 2026 · iceberg.apache.org
- Time travel
- Users can query a table snapshot from a specific version or timestamp and roll a table back to an earlier state.Read 7 Oct 2026 · iceberg.apache.org
Plans and prices
Strong points and limits
Strong points
- Works with several major analytic engines
- Schema changes avoid table rewrites
- Snapshot queries and rollback supported
- Optimistic concurrency supports multiple writers
- Apache License 2.0 open source
Limits
- Version 1.12.0 removes Spark 3.4 support
- Version 1.12.0 removes Flink 2.0 support
- Requires self-hosted deployment and provided storage
Who it suits
It suits teams managing analytic tables across multiple processing engines and needing schema changes, snapshots, rollback, or concurrent writes. It is intended for self-hosted deployments using user-provided storage.
Verdict
Apache Iceberg combines multi-engine table access with schema evolution, partition management, snapshots, and transactional write behavior. Check the 1.12.0 engine compatibility notes before upgrading.
Where Specifiction places it
- Data Version Control Tools#3 of 368.7
- Analytics Data#5 of 308.6