Skip to content
SPECIFICTION
Get listed

Amazon FSx for Lustre vs Hadoop Distributed File System

Amazon FSx for Lustre

aws.amazon.com

Hadoop Distributed File System

hadoop.apache.org

Side by side

FigureAmazon FSx for LustreHadoop Distributed File System
Price from—Free
Free plan—Yes
Free trial——
Open source——
WebYes—
Windows—Yes
macOS—Yes
LinuxYesYes
APIYesYes
Self-hostedYesYes
Plans published21
Spec score · Distributed File System Software7.9 (#10)8.2 (#9)

Plans

Amazon FSx for Lustre

  • Intelligent-Tiering (elastic) storage classPrice not published
  • SSD or HDD (provisioned) storage classPrice not published

Amazon FSx for Lustre pricing →

Hadoop Distributed File System

  • Apache Hadoop (open source)Free

Hadoop Distributed File System pricing →

In their own words

Amazon FSx for Lustre

Amazon FSx for Lustre has no write-up on Specifiction yet; its figures are above.

Visit aws.amazon.com

Hadoop Distributed File System

Hadoop Distributed File System (HDFS) is the primary distributed storage used by Hadoop applications. Its clusters use a NameNode to manage filesystem metadata and DataNodes to store data. HDFS is designed for fault tolerance on commodity hardware and high-throughput streaming access and batch processing, not low latency. It is tuned for files from gigabytes to terabytes, clusters with hundreds of nodes, and tens of millions of files in one instance. Administration includes shell-like commands, NameNode and DataNode web servers, fsck diagnostics, safemode, and a cluster balancer. Its permissions model shares much with POSIX and can optionally use POSIX ACLs; authentication supports simple operating-system identity or Kerberos. Configured encryption protects data at rest and in transit using encryption zones and the Hadoop Key Management Server. WebHDFS provides a REST API, and listed storage integrations include Amazon S3, Azure Blob Storage, Azure Data Lake Storage, and Tencent COS. HDFS is free to use under Apache License 2.0, with self-hosted cluster deployment.

Visit hadoop.apache.org