Run batch jobs using AWS Batch

AWS Batch enables developers, scientists, and engineers to easily and efficiently run hundreds of thousands of batch computing jobs on AWS. AWS Batch dynamically provisions the optimal quantity and type of compute resources (e.g., CPU or memory optimiz…


This content originally appeared on DEV Community and was authored by Ajit Singh

AWS Batch enables developers, scientists, and engineers to easily and efficiently run hundreds of thousands of batch computing jobs on AWS. AWS Batch dynamically provisions the optimal quantity and type of compute resources (e.g., CPU or memory optimized instances) based on the volume and specific resource requirements of the batch jobs submitted.

what is a batch job?

A batch job is a job with a start and end to it as opposed to a continuous job that runs 24X7

AWS batch features

  1. Batch processing service at any scale.

  2. It provision the right amount of EC2 instances or Spot instances for processing the batch job based on the volume and the requirements

  3. You submit or schedule batch jobs and AWS manages the rest

  4. There run as Docker images.

Use cases

  1. Pulling data form somewhere at night

  2. Backups at midnight

  3. Financial data processing each day


This content originally appeared on DEV Community and was authored by Ajit Singh


Print Share Comment Cite Upload Translate Updates
APA

Ajit Singh | Sciencx (2021-08-31T09:57:00+00:00) Run batch jobs using AWS Batch. Retrieved from https://www.scien.cx/2021/08/31/run-batch-jobs-using-aws-batch/

MLA
" » Run batch jobs using AWS Batch." Ajit Singh | Sciencx - Tuesday August 31, 2021, https://www.scien.cx/2021/08/31/run-batch-jobs-using-aws-batch/
HARVARD
Ajit Singh | Sciencx Tuesday August 31, 2021 » Run batch jobs using AWS Batch., viewed ,<https://www.scien.cx/2021/08/31/run-batch-jobs-using-aws-batch/>
VANCOUVER
Ajit Singh | Sciencx - » Run batch jobs using AWS Batch. [Internet]. [Accessed ]. Available from: https://www.scien.cx/2021/08/31/run-batch-jobs-using-aws-batch/
CHICAGO
" » Run batch jobs using AWS Batch." Ajit Singh | Sciencx - Accessed . https://www.scien.cx/2021/08/31/run-batch-jobs-using-aws-batch/
IEEE
" » Run batch jobs using AWS Batch." Ajit Singh | Sciencx [Online]. Available: https://www.scien.cx/2021/08/31/run-batch-jobs-using-aws-batch/. [Accessed: ]
rf:citation
» Run batch jobs using AWS Batch | Ajit Singh | Sciencx | https://www.scien.cx/2021/08/31/run-batch-jobs-using-aws-batch/ |

Please log in to upload a file.




There are no updates yet.
Click the Upload button above to add an update.

You must be logged in to translate posts. Please log in or register.