SC20 Tutorial

Welcome to the Best Practices for HPC in the Cloud tutorial at SC 20 that will be delivered on November 9th 2020 and November 11th 2020. We are excited to virtually meet you, and look forward to answering your questions! The website will be maintained after SC20, labs will also be available on https://www.hpcworkshops.com within a few weeks after the conference.

We are always looking at ways to make this tutorial even better. Please provide feedback and comments here: https://bit.ly/sc20cloud.

Sandbox were available between Nov 9th to 10th for the duration of the tutorial. If you would like to run through the labs at a later stage on your own, with your company or institution, please contact us at sc20tutorial@amazon.com so we can follow-up with you.

Important Information & Updates

For the tutorial recordings delivered on the APJ timezone, please use Gitter to for questions or support during the tutorial

Need help?

Email: you can contact us directly before, during and after the conference through this email: sc20tutorial@amazon.com
Gitter: a Gitter room can be access for the duration of the tutorial which you can use to contact us for advice or help: https://gitter.im/aws-sc20/general

Tutorial Content & Resources

Tutorial Resources

Before and during the tutorial you may be interested in going through the following sections:

Agenda of the tutorial.
FAQ answers to common questions will be communicated here during the tutorial.
Lab account on how to access your lab account.

Presentations Slides

The last version of the tutorial slides are available in your Tutorial attendee packet. Do not hesitate to contact us at sc20tutorial@amazon.com.

SC20 Hands-on Labs

Throughout the tutorial we will be going through the following labs:

Lab 0: Environment Prep: It has to be done before running the first lab. It will grant you access to a web-based development environment and terminals. This ensure that every one can run the labs regardless of their operating system.
Lab 1: Create an HPC Cluster: You will be lead to create your first HPC system in the Cloud.
Lab 2: Serverless Computing: We will see how to build an API interface and submit jobs on Slurm using a serverless (Lambda) function.
Lab 3: Storage Lab: In this lab you will learn how to build a Lustre file system in the Cloud, no need to hold a PhD in storage for that.
Lab 4: Performance Monitoring at Scale: This lab gives an overview of different methods and tools that can be used to assess application and infrastructure performance of your HPC cluster in the cloud.

Optional Labs

If you are interested to run additional labs don’t hesitate to run one of these:

Optional 1: Running Serverless Simulations: You will be introduced to AWS Batch which provides scheduling and orchestration functionalities to run jobs at scale in the cloud.
Optional 2: Remote Visualization: In this part we will introduce you to NICE DCV in order to visualize data residing in the cloud.
Optional 3: Low Latency Network: This part drives your through Elastic Fabric Adapter (EFA), a low latency network interface which can be used to run your tightly coupled workloads in the cloud. You may want to run the benchmark GPCNET as a stretch goal to collect the tail latency on EFA. This lab cannot be tested during SC20 with your Event Engine Account due to the limited resources that these accounts provide
Optional 4: Distributed Machine Learning: This lab will enable you to run a Machine Learning distributed workload using the PyTorch DistributedDataParallel API.

Accessing Your Lab Account

Once you get your credentials during the tutorial, access your account through https://dashboard.eventengine.run.

Report an issue on GitHub Contact AWS HPC Team Learn more