HPCC Systems vs Tencent Cloud Data Lake Compute (DLC)

HPCC Systems is a free, open-source platform for enterprise big-data processing and data-lake management. Its core components are ECL, a declarative and modular language, Thor for data refinement, and Roxie for data delivery. ECL's compiler optimizes programs for parallel processing and compiles them into C++. Thor handles ingestion, transformation, linking, and indexing; Roxie serves concurrent queries. Clusters can scale from two computers to more than a thousand commodity-hardware nodes. The cloud-native platform runs on Kubernetes and supports Azure Kubernetes Service and Amazon Elastic Kubernetes Service. Storage options include AWS S3, Azure Blob Storage, AWS Elastic Block Store, Azure Files, and Azure Disks. Security capabilities include end-to-end encryption, service meshes, OAuth 2.0 with Azure AD support, JWT, and configurable controls for data and services. The Machine Learning Library offers ECL-accessible algorithms for building and testing prediction models. Integrations include Spark, Kafka, Couchbase, Redis, Memcached, Pentaho, R, JDBC, Java APIs, and Tableau data connectors. ESP exposes queries through XML, HTTP, SOAP, and REST interfaces, and deployed queries can be called with REST/JSON. The platform is free to use under the Apache 2.0 license and is self-hosted.

Tencent Cloud Data Lake Compute (DLC) is a cloud service for querying data through shared or dedicated engines. It includes a metadata catalog, governance controls, and support for open table formats. Queries are available through both a graphical interface and a command-line interface. DLC lists three plans: Shared engine, Dedicated engine pay-as-you-go, and Dedicated engine subscription. Shared engine billing is based on successfully scanned query data. The dedicated engine plans use compute units, with one CU described as approximately one CPU core and 4 GB of memory. The service is paid and has no free plan. Its listed platform is web, so access is browser-based. The plan choices separate scanned-data billing from dedicated capacity, with dedicated resources available under either pay-as-you-go or subscription terms. DLC therefore combines query access with cataloging and governance in a cloud deployment.