BioImageTools/spark_prepare

module

Prepare work directory for running a Spark cluster

spark

Module Information

Repository: https://github.com/BioImageTools/nextflow-modules/tree/main/modules/bits/spark/prepare
Source: BioImageTools
Organization: BioImageTools
Authors: @krokicki , @cgoina

Apache Spark is an analytics engine for large-scale data processing

License: Apache License 2.0

Name	Type	Description
spark_work_dir	path	Parent directory where the cluster work directory should be created
spark_work_dir_name	string	Name of cluster work directory

Name	Type	Description
cluster_work_fullpath	string	Full path to the cluster work directory

Include this module in your Nextflow pipeline:

include { SPARK_PREPARE } from 'https://github.com/BioImageTools/nextflow-modules/tree/main/modules/bits/spark/prepare'