Apache Hudi vs Oxen

Apache Hudi is a free, open-source data lakehouse platform that adds database capabilities to data lakes and supports incremental processing for low-latency analytics. It can update and delete records, with pluggable indexing for change-data-capture and streaming workloads. Transaction features include atomic writes, snapshot isolation, and non-blocking concurrency controls. Users can query historical table versions, roll back changes, and review commit history. Automated table services handle clustering, compaction, cleaning, file sizing, and indexing, while schema evolution and enforcement accommodate changing data. Listed integrations include Apache Spark, Apache Flink, Kafka, Debezium, Amazon S3, Google Cloud Storage, Azure Blob Storage, Trino, and dbt. Some integrations are read-only, so Spark or Flink may write Hudi tables for those systems to query. Downloads include source releases and Maven bundles, with PGP verification advised. Hudi relies on the security posture of its compute and storage environment.

Oxen combines access to AI models with tools for organizing and versioning the data used with them. Its unified API provides more than 200 text, image, video, and audio models. Oxen versions prompts, media, labels, metadata, generated outputs, and training examples, and says it can scale to millions of files and terabytes of data. Teams can browse datasets, review generated work, experiment across branches, and track who changed what and when. Users can fine-tune supported open-source models on proprietary text, image, and video datasets. Data can be read or written through the Python API, HTTP API, command line, or open-source server. Private deployment is available in a customer’s VPC or fully on-premises. Explorer is free and includes unlimited public repositories and collaborators, five private repositories, up to three private collaborators, and 50gb each of storage and transfer. Hacker costs $30 a month; Pro costs $60 a month. Model inference is pay as you go; dedicated GPUs are charged per second and shut down after 15 minutes of inactivity.