Large scale computations and data analysis on the Hábrók cluster (Advanced)

When: 20 May 2025
Where: 5415.0032 Landleven 1

Large scale computations and data analysis on the Hábrók cluster (Advanced)

In this four hour course, which is a follow-up to the Hábrók introduction course, an overview of several parallelization and job handling methods will be given. This will help you in making a more effective use of the Hábrók cluster.

Who Should Attend?

This course is intended for people who are already using Hábrók, or are otherwise already familiar with using a compute cluster, but would like to expand their knowledge and get some tips on optimizing their workflows.

Users who are not familiar with using HPC clusters or have never used Hábrók, might want to consider the Large scale computations and data analysis on the Hábrók cluster course (Basic) instead, which takes place every month.

Prerequisits

For this course basic knowledge about the Linux command line, and the Hábrók cluster is assumed.

What do you learn?

✅ Some details of modern system architecture
✅ Differences between shared and distributed memory parallelization
✅ Introduction to bash scripting for writing advanced job scripts
✅ Job arrays, submitting many jobs at the same time

The course will focus on getting familiar with the concepts, not on a thorough explanation of all the details, as the latter would not fit in a single afternoon.

Preparation

• All the materials for this course are available on our wiki.
• An email with practical details on finding the rooms, software to install, etc. will be sent to all registered participants a week before the course and a reminder will be sent during the morning of the course day.
• A Hábrók account is required, which also requires an active UG account. Mode details on requesting accounts can be found on our wiki.

Result

After the course you should be able to understand how to work with shared or distributed memory applications running on multiple CPU cores on the cluster. You should be able to write more advanced job scripts that make it possible to automate job tasks. Finally you should be able to perform parameter sweeps using job arrays.

Enrollment and course fee

Attendance is free, but registration is required. The registration for this course opens at Tuesday 18 February 2025.

More information

• The course is given by one or two members of the HPC support team.
• For more questions on the workshop you can mail hpc rug.nl.