Training session in scaling up your analysis using containersΒΆ
Trainers (Mats Rynge, Nicholas Hazekamp and Kyle Sweeney)
In this exciting session of the workshop, we will show you how to scale your analyses (simple apps and complex workflow) using Docker swarm, Google Kubernetes and Workflows Management Systems such as Pegasus, Work-Queue and Makeflow from laptop to Cloud to HPC resources such as Stampede2, OSG and campus clusters and also show how using several compute clusters, you can scale your analysis significantly and efficiently. Some of the topics include:
- OSG (Open Science Grid) Singularity Infrastructure (Mats Rynge)
- Pegasus Workflows with Application Containers (Mats Rynge)
- Distributed computing with containers (Nicholas and Kyle remotely)