Google Cloud Batch vs HTCondor

Google Cloud Batch schedules, queues, and runs batch jobs on Google infrastructure. It obtains resources for jobs, creates or removes them during runtime to match job specifications, and can scale compute resources automatically for parallel work. Jobs run executable scripts or containerized workloads, with tasks arranged sequentially or in parallel. Storage options include persistent disks, local SSDs, Cloud Storage buckets, and network file systems such as Filestore. Integrations identified for a developer workflow include Cloud Storage, Pub/Sub, Cloud Logging, and Workflows. Batch can send job and task state changes through Pub/Sub, with notifications streamable to BigQuery. It supports IAM permissions and VPC Service Controls; Secret Manager can provide sensitive job data. Batch itself has no additional charge, but resources used by jobs are billed, and quotas and limits apply. Each job is restricted to one task group, named group0, and finished jobs are automatically deleted after 60 days unless deleted earlier. It is available through API and web, with cloud deployment.

HTCondor is a free workload management system for compute-intensive jobs. It queues and schedules work, sets priorities, and monitors and manages computing resources across networked clusters, cloud resources, and international grids. Its ClassAd mechanism matches job requests with machine offers using configurable requirements and preferences. If a machine becomes unavailable during a job, HTCondor can restart that job on another machine. It can transfer job data when machines do not share a file system, or route job input and output through the submit machine. Separate installations can collaborate through flocking, and HTCondor-G works with Globus-managed resources. It is self-hosted and supports Linux, MacOS, and Windows. Feature release 25.14.1 adds a metric daemon that exports metrics to Prometheus and Ganglia. HTCSS is licensed under Apache License 2.0 and distributed without warranties or conditions. Contracted support is available; fees vary by support policy.