Horovod

Spec sheet

Purpose

Horovod is a distributed deep learning training framework for TensorFlow, Keras, PyTorch and Apache MXNet.Read 9 Oct 2026 · horovod.ai

Deployment

Horovod can be installed on-premise or run on AWS, Azure and Databricks.Read 9 Oct 2026 · horovod.ai

Security

The documentation includes a security section for Horovod on Spark; the opened pages make no security certification or compliance claim.Read 9 Oct 2026 · horovod.readthedocs.io

Support

The project directs users to documentation, troubleshooting guidance and a ticket submission link for unresolved issues.Read 9 Oct 2026 · github.com

Autotuning

Horovod includes automated performance tuning that can be enabled with a command-line argument.Read 9 Oct 2026 · github.com

Collectives

Its distributed optimizer averages gradients using allreduce or allgather before applying them.Read 9 Oct 2026 · github.com

Installation

The getting-started page provides pip installation commands for CPU use and GPU use with NCCL.Read 9 Oct 2026 · horovod.ai

MPI alternative

Gloo is included and allows Horovod to run without MPI installed.Read 9 Oct 2026 · github.com

Open source

Horovod is described as an open source project hosted by the LF AI & Data Foundation.Read 9 Oct 2026 · github.com

Performance

Tensor Fusion batches small allreduce operations and interleaves communication with computation.Read 9 Oct 2026 · github.com

Project status

The repository says Horovod was archived in September 2026 due to inactivity and is read-only.Read 9 Oct 2026 · github.com

Requirements

The project README says Linux or macOS installation requires CMake and describes compiler requirements for supported frameworks.Read 9 Oct 2026 · github.com

Runtime integrations

Documentation describes running Horovod with Docker, Kubernetes, Spark, Ray, Singularity, LSF and Hadoop Yarn.Read 9 Oct 2026 · github.com

Scale

The project site says an existing training script can be scaled to hundreds of GPUs with a few lines of Python code.Read 9 Oct 2026 · horovod.ai

Spark

Horovod can run on Apache Spark to combine data processing and model training in one pipeline.Read 9 Oct 2026 · horovod.ai

Plans and prices

Every Horovod plan and price →

Where Specifiction places it

• Deep Learning Software#11 of 358.1