AWS Batch vs HCL Workload Automation

AWS Batch plans, schedules, and runs containerized batch workloads for machine learning, simulation, and analytics. It provisions and scales compute on Amazon ECS, Amazon EKS, and AWS Fargate, with Spot and On-Demand instance options. Jobs can be submitted through the AWS Management Console, command line interfaces, or software development kits, and specify memory and vCPU requirements. Queues support priorities, dependencies, retries, and scheduling based on resource needs. Jobs can request GPUs, which Batch can scale for and isolate to the appropriate containers. For high-communication workloads, it supports multi-node parallel jobs across EC2 instances and Elastic Fabric Adapter. Workflow integrations include Pegasus WMS, Luigi, Nextflow, Metaflow, Apache Airflow, and AWS Step Functions. The console shows compute capacity and job metrics; job logs appear in the console and Amazon CloudWatch Logs. AWS Batch runs in the cloud and supports API, Linux, macOS, web, and Windows access. The service itself has no additional charge, but compute and storage resources used to store and run jobs are billed separately. Jobs need to be executable as Docker containers. Security follows a shared responsibility model: AWS protects cloud infrastructure, while customers are responsible for security in their own cloud use.

HCL Workload Automation is software for defining, scheduling, managing, and monitoring critical batch processes. It groups scheduled jobs into job streams and supports dependencies, time constraints, and automatic recovery procedures. Graphical views, embedded analytics, and customizable dashboards help teams follow jobs and streams. Event rules can trigger jobs, respond to prompts, notify users of anomalies, or invoke an external product when conditions occur. Documented integrations include Jira, ServiceNow, RESTful APIs, JSONata, and IBM Robotic Process Automation; HCL says Automation Hub provides over 100 plugins at no additional cost. Tasks can run through local agents, without agents, or through APIs, and the product supports container and hybrid deployments, including Docker, Red Hat OpenShift, and a cloud-native service in a customer-chosen cloud. Pricing is available on request, and HCL advertises a 90-day free trial. From version 10.2, customers need their own WebSphere Application Server Liberty and Db2 licenses to keep using them.