Hadoop Distributed File System vs OrangeFS
Hadoop Distributed File System
hadoop.apache.orgOrangeFS
orangefs.comSide by side
| Figure | Hadoop Distributed File System | OrangeFS |
|---|---|---|
| Price from | Free | Free |
| Free plan | Yes | Yes |
| Free trial | — | — |
| Open source | — | — |
| Windows | Yes | Yes |
| macOS | Yes | Yes |
| Linux | Yes | Yes |
| API | Yes | Yes |
| Self-hosted | Yes | Yes |
| Plans published | 1 | 2 |
| Spec score · Distributed File System Software | 8.2 (#9) | 7.7 (#16) |
| Architecture | An HDFS cluster primarily consists of a NameNode managing filesystem metadata and DataNodes storing data. | Its user-level server and client provide parallel access to multi-server disk storage. |
| License | Apache Hadoop is licensed under the Apache License 2.0. | OrangeFS is released under the LGPL License, with some recent portions also available under LGPL and Apache 2. |
| Purpose | HDFS is the primary distributed storage used by Hadoop applications. | OrangeFS is a scale-out parallel storage system aimed at large storage workloads in HPC, Big Data, streaming video, genomics, and bioinformatics. |
| Support | Apache Hadoop support is provided through project mailing lists maintained by non-paid volunteers. | Community support is available through the mailing list, and the maker offers commercial and research support. |
Plans
Hadoop Distributed File System
- Apache Hadoop (open source)Free
In their own words
Hadoop Distributed File System
Hadoop Distributed File System (HDFS) is the primary distributed storage used by Hadoop applications. Its clusters use a NameNode to manage filesystem metadata and DataNodes to store data. HDFS is designed for fault tolerance on commodity hardware and high-throughput streaming access and batch processing, not low latency. It is tuned for files from gigabytes to terabytes, clusters with hundreds of nodes, and tens of millions of files in one instance. Administration includes shell-like commands, NameNode and DataNode web servers, fsck diagnostics, safemode, and a cluster balancer. Its permissions model shares much with POSIX and can optionally use POSIX ACLs; authentication supports simple operating-system identity or Kerberos. Configured encryption protects data at rest and in transit using encryption zones and the Hadoop Key Management Server. WebHDFS provides a REST API, and listed storage integrations include Amazon S3, Azure Blob Storage, Azure Data Lake Storage, and Tencent COS. HDFS is free to use under Apache License 2.0, with self-hosted cluster deployment.
OrangeFS
OrangeFS is a free, open-source parallel storage system for large workloads in high-performance computing, Big Data, streaming video, genomics, and bioinformatics. Its user-level servers and clients let applications access disk storage across multiple servers in parallel. Configurable file striping and distributed metadata, including directory metadata, support this layout. OrangeFS supports Linux, macOS, Windows, APIs, and self-hosted deployment. Linux integration uses a kernel client available in the mainline kernel since version 4.6, and the documentation recommends the upstream kernel module. Other interfaces include a native Windows parallel client, FUSE for Linux and Mac, a direct Linux application interface, Java JNI, Hadoop HCFS, WebDAV, and optimized MPI-IO; S3 is also listed among the file access protocols. Security options include capability-based security and default, key-based, and certificate-based modes. LDAP mapping can associate a client certificate subject with a user ID and primary group ID. CloudyCluster offers configurable deployments through Google Cloud and AWS marketplaces. The open-source software is free; commercial and research support is available by quote.