This week Alastair Droop gave a talk about and demo of pipelines and workflow management in HPC.
The talk describes what pipelines / workflow managers are, why we might want to use them, and demonstrates a particular workflow management engine called Nextflow.
The slides can be found here
A recording of the talk can be viewed here