Apache Hadoop HDFS vs Tencent Cloud Data Lake Compute (DLC)

Apache Hadoop HDFS is a free, open-source distributed file system for high-throughput access to large application data sets on commodity hardware. It is designed for clusters of hundreds of nodes and can support tens of millions of files in one instance. HDFS copies file blocks across machines and detects failed DataNodes so it can start creating replacement copies. Its design prioritizes batch processing and streaming throughput rather than low-latency interactive workloads. Files follow a write-once, read-many model: appends and truncates are supported, but arbitrary in-place changes are not. Applications can connect through Java, a C wrapper, REST, a browser interface or an NFS gateway. The documentation lists connectors for Google Cloud Storage, Amazon S3, Azure Blob Storage and Azure Data Lake Storage. HDFS supports transparent encryption. Apache warns that without Kerberos caller authentication, anyone with network access to cluster servers can access data and run code, and recommends securing clusters before production. Apache also recommends checking release downloads with GPG signatures or SHA-512 checksums. The listed stable release is Hadoop 3.5.0, dated April 2, 2026.

Tencent Cloud Data Lake Compute (DLC) is a cloud service for querying data through shared or dedicated engines. It includes a metadata catalog, governance controls, and support for open table formats. Queries are available through both a graphical interface and a command-line interface. DLC lists three plans: Shared engine, Dedicated engine pay-as-you-go, and Dedicated engine subscription. Shared engine billing is based on successfully scanned query data. The dedicated engine plans use compute units, with one CU described as approximately one CPU core and 4 GB of memory. The service is paid and has no free plan. Its listed platform is web, so access is browser-based. The plan choices separate scanned-data billing from dedicated capacity, with dedicated resources available under either pay-as-you-go or subscription terms. DLC therefore combines query access with cataloging and governance in a cloud deployment.