Apache Hudi vs Qubole

Apache Hudi is a free, open-source data lakehouse platform that adds database capabilities to data lakes and supports incremental processing for low-latency analytics. It can update and delete records, with pluggable indexing for change-data-capture and streaming workloads. Transaction features include atomic writes, snapshot isolation, and non-blocking concurrency controls. Users can query historical table versions, roll back changes, and review commit history. Automated table services handle clustering, compaction, cleaning, file sizing, and indexing, while schema evolution and enforcement accommodate changing data. Listed integrations include Apache Spark, Apache Flink, Kafka, Debezium, Amazon S3, Google Cloud Storage, Azure Blob Storage, Trino, and dbt. Some integrations are read-only, so Spark or Flink may write Hudi tables for those systems to query. Downloads include source releases and Maven bundles, with PGP verification advised. Hudi relies on the security posture of its compute and storage environment.

Qubole is a cloud data lake platform for data engineering, data management, streaming analysis, machine learning, data exploration, and ad-hoc analytics. It lists support for AWS, Microsoft Azure, Google Cloud Platform, and Oracle Cloud Infrastructure, alongside Apache Spark, Presto, Hive/Hadoop, TensorFlow, and Airflow. Workbench lets users author, save, template, and share reports and queries, with optimized Presto SQL, Tableau and Looker integrations, and Git integration. The Assisted Pipeline Builder combines batch or streaming sources into streaming pipelines using fault-tolerant infrastructure. Qubole says it provisions, manages, and optimizes cloud resources, including workload-aware autoscaling and real-time spot buying. Security controls include encryption, role-based access, and integration with cloud IAM, Active Directory, and LDAP. The service states a 99.9% availability commitment, excluding scheduled and communicated maintenance. A 30-day full-featured trial is listed. Enterprise Edition is priced on request, billed per QCU per hr, and requires an annual contract; On-Demand is priced on request, billed per QCU per hr. Both exclude user fees; On-Demand lists them as $108 per user per month.