Data-driven computational pipelines
Nextflow enables scalable and reproducible scientific workflows using software containers. It allows the adaptation of pipelines written in the most common scripting languages.
Its fluent DSL simplifies the implementation and the deployment of complex parallel and reactive workflows on clouds and clusters.
module spider nextflow to find out what environment modules are available for this application.
- HPC_NEXTFLOW_DIR - installation directory
Nextflow appears to be very sensitive to Lustre quota state. If your group has both a soft and a hard quota on /blue (Burst Quota) then nextflow may start randomly crashing with SIGBUS errors when running out of /blue directories. If you observe such errors reduce your quota usage below the soft limit (the amount paid for) and do not rely on the availability of the burst quota (hard limit).