Jobs management

While slurm is the default tool for job management on the GIGA cluster, there are other tools that are able to interact with it to simplify the process of configuring complex workflows.

For instance, Nextflow can be used to submit and orchestrate a large number of interdependent jobs. It also allows for hot restart (i.e., restarting from the latest results), provides stats on the executed tasks and integrates easily with conda and singularity.

Job management tools

• nextflow - Nextflow workflow manager
• slurm - Slurm workload manager