BioImageTools/spark_startmanager

module

Start a Spark manager which runs until the terminate module is called

spark

Module Information

Repository: https://github.com/BioImageTools/nextflow-modules/tree/main/modules/bits/spark/startmanager
Source: BioImageTools
Organization: BioImageTools
Authors: @krokicki , @cgoina

Apache Spark is an analytics engine for large-scale data processing

License: Apache License 2.0

Name	Type	Description
cluster_work_dir	path	The cluster work directory where the manager will run

Name	Type	Description
cluster_work_fullpath	string	Full path to the cluster work directory where the manager is running

Include this module in your Nextflow pipeline:

include { SPARK_STARTMANAGER } from 'https://github.com/BioImageTools/nextflow-modules/tree/main/modules/bits/spark/startmanager'