Chaos Toolkit vs Pumba

Chaos Toolkit is a free, open-source chaos engineering toolkit for developers exploring systems to uncover weaknesses. Experiments define a steady-state hypothesis and probes to check it, along with a method of actions and probes. If the system does not meet the stated steady state, the method is not applied and the experiment must stop. Experiments can be declared in JSON or YAML files, making them suitable for collaboration and orchestration alongside code. The toolkit extends to systems through its Open API and can be embedded in a CI/CD chain. Listed integrations include AWS, Azure, Google Cloud Platform, Kubernetes, Kafka, Slack, Datadog, Grafana, OpenTelemetry, and Prometheus. The standalone CLI is available under Apache License 2.0. It is implemented in Python 3, officially supports Python 3.8 and later, and has only been tested against CPython. Installation instructions cover macOS, Debian or Ubuntu, and Windows; users can install extensions after the CLI and core library. Reliably is a separate platform with SaaS, private SaaS, and on-premises options.

Pumba is a free, open-source chaos testing and network emulation tool for Docker, containerd, and Podman containers. It can kill, stop, pause, remove, and restart containers, while network experiments can add delay, packet loss, duplication, corruption, or rate limits through netem or iptables. Its stress command exercises CPU, memory, and I/O with stress-ng. Targets can be chosen by container name, regular expression, label, or random selection, and experiments can recur at fixed intervals. Pumba documents deployment with Docker, Kubernetes DaemonSets, and OpenShift, and supports Kubernetes workflows. Released binaries and a GitHub Container Registry image are available; the Docker Hub image is marked deprecated. Linux is the primary platform. macOS binaries drive a remote Linux container VM, while Windows is not supported or planned. Pumba runs self-hosted under the Apache License 2.0 and requires privileged access to container runtimes, so its guidance calls for controlled environments and restricted socket access. Security fixes apply only to the latest released minor version. Community support is directed to GitHub Issues and the project blog.