HPCC Systems vs Oracle Big Data Service

HPCC Systems is a free, open-source platform for enterprise big-data processing and data-lake management. Its core components are ECL, a declarative and modular language, Thor for data refinement, and Roxie for data delivery. ECL's compiler optimizes programs for parallel processing and compiles them into C++. Thor handles ingestion, transformation, linking, and indexing; Roxie serves concurrent queries. Clusters can scale from two computers to more than a thousand commodity-hardware nodes. The cloud-native platform runs on Kubernetes and supports Azure Kubernetes Service and Amazon Elastic Kubernetes Service. Storage options include AWS S3, Azure Blob Storage, AWS Elastic Block Store, Azure Files, and Azure Disks. Security capabilities include end-to-end encryption, service meshes, OAuth 2.0 with Azure AD support, JWT, and configurable controls for data and services. The Machine Learning Library offers ECL-accessible algorithms for building and testing prediction models. Integrations include Spark, Kafka, Couchbase, Redis, Memcached, Pentaho, R, JDBC, Java APIs, and Tableau data connectors. ESP exposes queries through XML, HTTP, SOAP, and REST interfaces, and deployed queries can be called with REST/JSON. The platform is free to use under the Apache 2.0 license and is self-hosted.

Oracle Big Data Service is a managed cloud service for creating Hadoop-based data lakes that process large amounts of data. Its distribution includes Apache Hadoop, Ambari, HBase, Hive, Spark, and other services. Customers can build clusters with OCI compute shapes, from small development environments to large production clusters on dedicated hardware, and choose NVMe or block storage. Clusters can be resized; secure, high-availability clusters are an option. Oracle Cloud SQL queries data across Hadoop, Kafka, NoSQL, and object stores using Oracle SQL. The service also describes SparkR for working with HDFS, Spark DataFrames, and JDBC sources and building models in R. Access is available through the OCI Console, CLI, REST APIs, and SDKs. Block Volume data is encrypted at rest by default, and OCI IAM controls authentication and authorization. Oracle describes both short-lived clusters for specific tasks and long-running data lakes. The listed service fee is 0.02 USD per OCPU per hour; compute and storage charges apply separately. Oracle lists separate hourly rates for compute shapes and Cloud SQL. Clusters need release updates to remain current and supported.