BioImageTools/spark_terminate

module

Terminate a Spark cluster by writing a marker file to the work dir

spark

Module Information

Repository: https://github.com/BioImageTools/nextflow-modules/tree/main/modules/bits/spark/terminate
Source: BioImageTools
Organization: BioImageTools
Authors: @krokicki , @cgoina

Apache Spark is an analytics engine for large-scale data processing

License: Apache License 2.0

Name	Type	Description
spark_uri	string	URI of the Spark manager
cluster_work_dir	path	The cluster work directory where the manager will run

Name	Type	Description
spark_uri	string	URI of the Spark manager
cluster_work_fullpath	string	Full path to the cluster work directory where the manager is running

Include this module in your Nextflow pipeline:

include { SPARK_TERMINATE } from 'https://github.com/BioImageTools/nextflow-modules/tree/main/modules/bits/spark/terminate'