Cisco pyATS vs M-Lab NDT

Cisco pyATS is a Python framework for network testing, automation, and validation, available free under the Apache 2.0 license. It supports sanity, feature, solution, system, and scale test and verification workflows, with reusable data-driven tests ranging from simple checks to complex asynchronous suites. Genie libraries provide device connectivity, parsers, APIs, platform-agnostic feature models, reusable test cases, and a YAML-driven test runner. Built-in device libraries cover Cisco IOS, IOS XE, IOS XR, NX-OS, and ASA; plugins and extensions can add other platforms. Connections can use CLI, NETCONF, or RESTCONF. XPRESSO manages test suites, environments, testbeds, resources, live test views, and archived results with comparisons and analytics. It supports on-demand, bundled, and scheduled runs through Jenkins and Docker backends. Cisco also documents Ansible community integrations and out-of-the-box RobotFramework support. pyATS runs on Linux and macOS and supports self-hosted deployment. Cisco says more than 75% of its codebase is open source on GitHub. Email support is best-effort and usually receives a reply within a day.

M-Lab NDT has no write-up on Specifiction yet; its figures are above.