Batch

Run AWS batch jobs without installing software or servers

You can perform AWS batch job processing directly in the DuploCloud Portal without the additional overhead of installed software, allowing you to focus on analyzing results and diagnosing problems.

Step 1: Create Batch Job Scheduling Policies (Optional)

Create scheduling policies to define when your batch job runs.

1. From the DuploCloud Portal, navigate to Cloud Services -> Batch page, and click the Scheduling Policies tab.

2. Click Add. The Create Batch Scheduling Policy page displays.

3. In the Create Batch Scheduling Policy page, create batch job scheduling policies using the AWS documentation. The fields in the AWS documentation map to the fields on the DuploCloud Create Batch Scheduling Policy page.

   

   The AWS Batch Create Batch Scheduling Policy page in the DuploCloud Portal
4. Click Create.

Step 2: Configure Compute Environments

AWS compute environments (Elastic Compute Cloud [EC2] instances) map to DuploCloud Infrastructures. The settings and constraints in the computing environment define how to configure and automatically launch the instance.

1. In the DuploCloud Portal, navigate to Cloud Services -> Batch.

2. Click the Compute Environments tab.

3. Click Add. The Add Batch Environment page displays.

4. In the Compute Environment Name field, enter a unique name for your environment.

5. In the Type field, select the environment type (On-Demand, Spot, Fargate, etc.).

6. Modify additional defaults on the page, as needed, or add configuration parameters in Other Configurations.

   

   AWS Batch Add Batch Environment page in the DuploCloud Portal
7. Click Create. The Compute Environment is created.

The Compute Environment window in the DuploCloud Portal showing the configured environment.

Step 3: Create Batch Job Queues

After you define job definitions, create queues for your batch jobs to run in. For more information about batch job queues, see the AWS instructions for creating a job queue.

1. From the DuploCloud Portal, navigate to Cloud Services -> Batch page, and click the Queues tab.

2. Click Add. The Create Batch Queue page displays.

   

   The AWS Batch Create Batch Queue page in the DuploCloud Portal
3. In the Create Batch Queue page, create batch job queues using the AWS documentation. The fields in the AWS documentation map to the fields on the DuploCloud Create Batch Queue page.

4. Click Create. The Batch Queue is created.

For Priority, enter a whole number. Job queues with a higher priority are run before those with a lower priority associated with the same compute environment.

Step 4: Create Batch Job Definitions

Before you can run AWS batch jobs, you need to create job definitions specifying how batch jobs are run.

1. From the DuploCloud Portal, navigate to Cloud Services -> Batch, and click the Job Definitions tab.

2. Click Add. The Create Batch Job Definition page displays.

   

   AWS Batch Create Batch Job Definition page in DuploCloud Portal
3. In the Create Batch Job Definition page, define your batch jobs using the AWS documentation. The fields in the AWS documentation map to the fields on the DuploCloud Create Batch Job Definition page.

4. Click Create. The Batch Job Definition is created.

   

   The Batch Job Definition configuration is shown in the DuploCloud Portal.

Step 5: Create a Batch Job

Add a job for AWS batch processing. See the AWS documentation for more information about batch jobs.

1. After you configure your compute environment, in the DuploCloud Portal, navigate to Cloud Services -> Batch, and click the Jobs tab.

2. Click Add. The Add Batch Job page displays.

   

   The Add Batch Job page in the DuploCloud Portal
3. On the Add Batch Job page, define a Job Name, Job Definition, Job Queue, and Job Properties.

4. Optionally, if you created a Scheduling Policy to apply to this job, paste the YAML code below into the Other Properties field.

5. Click Create. The Batch job is created.

Create a Batch Job with Scheduling Policy (Optional)

As you Create a Batch Job, paste the following YAML code into the Other Properties field on the Add Batch Job page.

  {    

    "schedulingpriorityoverride": 1,

    "ShareIdentifier": "add_identifier"

}

View Batch Jobs

Navigate from the DuploCloud Portal to Cloud Services -> Batch, and click the Jobs tab. The Jobs list displays.

The Job list shows the Batch Job in the DuploCloud Portal.

Click the name of the Job to view Job Details (Status, Job ID, Job Queue, Job Definition).

The Jobs window shows the running Batch Job in the DuploCloud Portal

Run AWS Batch jobs

Use the AWS Best Practices Guide for information about running your AWS Batch jobs.