Ceph vs Google Cloud Managed Lustre

Ceph is free, open-source distributed storage software for object, block, and file storage in one system. Organizations run clusters on commodity hardware that they choose and manage. Its RGW object storage supports the S3 API and Swift-compatible applications. RBD provides thin-provisioned disk images, snapshots, writable clones, and asynchronous mirroring to remote Ceph clusters. CephFS is a POSIX-compliant distributed filesystem with snapshots, quotas, and multi-cluster mirroring. The system can replicate data across devices, racks, and geographic locations, then redistribute it following hardware or connectivity failures. For Kubernetes, the project recommends Rook to run Ceph or connect an existing cluster; its CSI driver can provision block and file volumes. Installation choices include packages, container images, source clones, and tarballs. The cephadm tool requires Python 3, systemd, and Podman or Docker. Production guidance calls for at least three monitors, two managers, three OSDs, and 10 Gb/s networking between hosts. The project publishes a stable release annually and supports each series for approximately 24 months.

Google Cloud Managed Lustre is a fully managed parallel file system for artificial intelligence and high-performance computing workloads. Documented uses include HPC simulations, modeling and analysis, and machine-learning training and inference. It supports throughput up to 10 TBps and storage capacity up to 84,016,000 GiB (80.1 PiB). POSIX compliance is intended to preserve compatibility with existing applications, tools, and workflows. Instances can mount to Compute Engine virtual machines and Google Kubernetes Engine clusters. The service imports data from and exports data to Cloud Storage, including incremental transfers of new or changed files; only one transfer operation per instance can run at a time. Data is encrypted at rest and in transit to and within Google Cloud. Per-instance policies define maintenance windows and exclusion periods. Capacity is provisioned, and unused provisioned capacity is billed. Pricing is from $0.06/mo; hourly rates vary by month, and monthly charges use the hourly rate and hours in that month. Files can be up to 0.5 PiB, with 20 instances maximum per project. Lustre over TCP is supported, and managed backups are not available.