Apache Hudi vs Apache Iceberg

Apache Hudi is a free, open-source data lakehouse platform that adds database capabilities to data lakes and supports incremental processing for low-latency analytics. It can update and delete records, with pluggable indexing for change-data-capture and streaming workloads. Transaction features include atomic writes, snapshot isolation, and non-blocking concurrency controls. Users can query historical table versions, roll back changes, and review commit history. Automated table services handle clustering, compaction, cleaning, file sizing, and indexing, while schema evolution and enforcement accommodate changing data. Listed integrations include Apache Spark, Apache Flink, Kafka, Debezium, Amazon S3, Google Cloud Storage, Azure Blob Storage, Trino, and dbt. Some integrations are read-only, so Spark or Flink may write Hudi tables for those systems to query. Downloads include source releases and Maven bundles, with PGP verification advised. Hudi relies on the security posture of its compute and storage environment.

Apache Iceberg is a free, open-source table format for analytic datasets, including very large analytic tables. It is self-hosted and works through APIs on Linux, macOS, and Windows, using storage you provide. Engines such as Spark, Trino, Flink, Presto, Hive, and Impala can use the same tables. SQL commands support merging new data, updating rows, and targeted deletes. Columns can be added, renamed, or reordered without rewriting a table. Hidden partitioning creates partition values and skips unnecessary partitions and files. Table snapshots can be queried by version or timestamp, and tables can be rolled back. Atomic updates, serializable isolation, consistent snapshot reads, and optimistic concurrency support multiple writers. Integrations include Kafka Connect and catalogs such as AWS Glue, JDBC, and Nessie. Encryption supports AWS, Azure, or GCP KMS clients, including custom clients. Version 1.12.0 removes Spark 3.4 and Flink 2.0 support. The Apache License 2.0 applies.