Batfish vs Ostinato

Batfish is an open-source tool for analyzing network device configurations and validating network behavior. It works from configuration files, so core analysis does not require direct access to network devices. Teams can inspect deployed configurations and check planned changes before deployment. Checks cover undefined references, MTU and AAA settings, template compliance, sensitive-service reachability and expected traffic paths. Batfish can test whether end-to-end reachability survives any single-link or single-device failure, compare current and planned reachability, assess ACL or firewall changes and evaluate functional equivalence across vendors. Pybatfish provides a Python 3 SDK, and example Jupyter notebooks are available. An all-in-one Docker container bundles Batfish and notebooks. It runs on operating systems supporting Docker. Documented support includes Arista, AWS, Azure, Cisco, Juniper, Palo Alto Networks and SONiC, while Aruba, Dell Force10 and Foundry have limited support.

Ostinato generates and customizes network traffic, or replays PCAP files, to help validate throughput, QoS, multicast, routing, switching, protocol behavior, and network performance. Users can edit supported protocol headers, set frame sizes, and create custom headers with hexdumps or scripts. PCAP replay can preserve or alter packet timing, loop traffic, or reorder packets. Native protocols include Ethernet, VLAN, QinQ, IPv4/IPv6, UDP, stateless TCP, ICMP, ARP/NDP, IGMP/MLD, and GRE; other methods can support headers such as MPLS and VXLAN. Reports show transmit and receive statistics, per-stream packet loss, and latency and jitter measured with software timestamps. A Python API supports stream and scenario creation, run control, counter collection, and CI/CD integration. Ostinato lists GNS3, EVE-NG, Cisco CML, and Containerlab as supported lab environments, and says it works on AWS and Azure cloud VMs. It runs on Linux, macOS, Windows, and self-hosted or API setups. Plans start at $12 a month billed annually; an active subscription is required.