AWS ParallelCluster

hpc_logo

AWS ParallelCluster is an AWS-supported open source cluster management tool that helps you to deploy and manage High Performance Computing (HPC) clusters in the AWS Cloud. Built on the open source CfnCluster project, AWS ParallelCluster enables you to quickly build an HPC compute environment in AWS. It automatically sets up the required compute resources and shared filesystem. You can use AWS ParallelCluster with a variety of batch schedulers, such as AWS Batch, SGE, Torque, and Slurm. AWS ParallelCluster facilitates quick start proof of concept deployments and production deployments. You can also build higher level workflows, such as a genomics portal that automates an entire DNA sequencing workflow, on top of AWS ParallelCluster.

For this lab one will assume that you have an AWS Cloud9 IDE ready. If this is not the case, please run through the first half of Getting Started with AWS lab.

In this lab we will introduce you to AWS ParallelCluster and how to run your HPC jobs in AWS as you would on-premises. The steps we will be going through are the following:

  • Install and configure ParallelCluster on your AWS Cloud9 IDE.
  • Create your first cluster.
  • Submit a sample job and check what is happening in the background.
  • Delete the cluster.