Cloud cache plugin for Nextflow
Summary
The Cloud cache plugin provides cloud-based caching support for Nextflow pipelines. It enables workflow resume capability when using cloud storage as the work directory.
Get Started
To use this plugin, add it to your nextflow.config:
plugins {
id 'nf-cloudcache'
}
The plugin is automatically activated when using cloud storage (S3, GS, Azure Blob) as the work directory with resume enabled.
workDir = 's3://my-bucket/work'
Run your pipeline with the -resume flag:
nextflow run main.nf -resume
Examples
AWS S3 Cache
plugins {
id 'nf-amazon'
id 'nf-cloudcache'
}
workDir = 's3://my-bucket/work'
aws {
region = 'us-east-1'
}
Google Cloud Storage Cache
plugins {
id 'nf-google'
id 'nf-cloudcache'
}
workDir = 'gs://my-bucket/work'
google {
project = 'my-project'
location = 'us-central1'
}
Azure Blob Storage Cache
plugins {
id 'nf-azure'
id 'nf-cloudcache'
}
workDir = 'az://my-container/work'
azure {
storage {
accountName = 'mystorageaccount'
accountKey = System.getenv('AZURE_STORAGE_KEY')
}
}