Netpicker vs Ostinato

Netpicker validates network state, device configurations, compliance, security and behavior, and can automate remediation. It runs automated Python tests in pytest format against device configurations, show-command output and API data. The free version includes unlimited configuration backups, Git history, diffs, search and drift detection. Netpicker supports devices from more than 180 vendors and can be deployed as a Docker container or OVA virtual appliance, on-premises or in air-gapped environments. API-based connections link it to source-of-truth systems, Git, ITSM tools and other existing tools. Its REST API manages devices, backups and tests, runs show commands and tests, and restores backups; documentation is provided through Swagger/OpenAPI. Security validation covers CVEs, security configurations, compliance and pen-test findings without sending network data outside the customer's environment. Potential CVEs are matched by OS version, while verified CVEs also check whether vulnerable features are enabled and mitigations are present. AI can draft tests, remediation jobs and troubleshooting queries from plain English, subject to engineer review and approval. The free Foundation plan is available; Professional starts at $7,500 a year.

Ostinato generates and customizes network traffic, or replays PCAP files, to help validate throughput, QoS, multicast, routing, switching, protocol behavior, and network performance. Users can edit supported protocol headers, set frame sizes, and create custom headers with hexdumps or scripts. PCAP replay can preserve or alter packet timing, loop traffic, or reorder packets. Native protocols include Ethernet, VLAN, QinQ, IPv4/IPv6, UDP, stateless TCP, ICMP, ARP/NDP, IGMP/MLD, and GRE; other methods can support headers such as MPLS and VXLAN. Reports show transmit and receive statistics, per-stream packet loss, and latency and jitter measured with software timestamps. A Python API supports stream and scenario creation, run control, counter collection, and CI/CD integration. Ostinato lists GNS3, EVE-NG, Cisco CML, and Containerlab as supported lab environments, and says it works on AWS and Azure cloud VMs. It runs on Linux, macOS, Windows, and self-hosted or API setups. Plans start at $12 a month billed annually; an active subscription is required.