Hadoop Distributed File System vs Panzura CloudFS
Hadoop Distributed File System
hadoop.apache.org
Panzura CloudFS
panzura.comSide by side
| Figure | Hadoop Distributed File System | Panzura CloudFS |
|---|---|---|
| Price from | Free | — |
| Free plan | Yes | — |
| Free trial | — | — |
| Open source | — | — |
| Windows | Yes | — |
| macOS | Yes | — |
| Linux | Yes | — |
| API | Yes | Yes |
| Self-hosted | Yes | Yes |
| Plans published | 1 | 1 |
| Spec score · Distributed File System Software | 8.2 (#9) | 7.0 (#23) |
| Encryption | Configured HDFS encryption provides transparent end-to-end encryption for data at rest and in transit using encryption zones and the Hadoop Key Management Server. | Panzura states that CloudFS encrypts data at rest with AES 256-bit algorithms and data in transit with TLS 1.3. |
| Purpose | HDFS is the primary distributed storage used by Hadoop applications. | CloudFS provides one authoritative global file data set in object storage for distributed sites to access directly. |
| Support | Apache Hadoop support is provided through project mailing lists maintained by non-paid volunteers. | Panzura provides a Service Hub for support and says a team can release a lock left by an offline user without a support ticket. |
Plans
Hadoop Distributed File System
- Apache Hadoop (open source)Free
In their own words
Hadoop Distributed File System
Hadoop Distributed File System (HDFS) is the primary distributed storage used by Hadoop applications. Its clusters use a NameNode to manage filesystem metadata and DataNodes to store data. HDFS is designed for fault tolerance on commodity hardware and high-throughput streaming access and batch processing, not low latency. It is tuned for files from gigabytes to terabytes, clusters with hundreds of nodes, and tens of millions of files in one instance. Administration includes shell-like commands, NameNode and DataNode web servers, fsck diagnostics, safemode, and a cluster balancer. Its permissions model shares much with POSIX and can optionally use POSIX ACLs; authentication supports simple operating-system identity or Kerberos. Configured encryption protects data at rest and in transit using encryption zones and the Hadoop Key Management Server. WebHDFS provides a REST API, and listed storage integrations include Amazon S3, Azure Blob Storage, Azure Data Lake Storage, and Tencent COS. HDFS is free to use under Apache License 2.0, with self-hosted cluster deployment.
Panzura CloudFS
Panzura CloudFS has no write-up on Specifiction yet; its figures are above.