Apache NiFi vs Google Cloud Dataflow

Apache NiFi is free, open-source software for automating data movement between systems, including cybersecurity, observability, event stream, and generative AI pipelines. Its browser-based interface lets users design, control, and monitor dataflows and receive feedback. NiFi records and indexes provenance data to track information as it passes through the system. Flow controls include guaranteed delivery, back pressure, prioritized queues, and quality-of-service settings for individual flows. Users can change dataflows while they run, applying updates to affected components without stopping the whole flow. Documented processors connect to Kafka, AWS, Azure, Google Cloud, databases, Slack, S3, and Salesforce. Security features include HTTPS, configurable authentication, multi-tenant authorization, and encrypted communications such as TLS and SSH. NiFi runs in a JVM on a host operating system and can be installed from a ZIP archive. It supports clustering and can scale down to edge devices through MiNiFi. The project lists a users mailing list and Slack workspace for questions and problem reports. Its security model assigns users responsibility for operating-system commands and custom code they configure.

Google Cloud Dataflow has no write-up on Specifiction yet; its figures are above.