BioImageTools/spark_waitforworker

module

Wait for a Spark worker to be ready

spark

Module Information

Repository: https://github.com/BioImageTools/nextflow-modules/tree/main/modules/bits/spark/waitforworker
Source: BioImageTools
Organization: BioImageTools
Authors: @krokicki , @cgoina

Apache Spark is an analytics engine for large-scale data processing

License: Apache License 2.0

Name	Type	Description
spark_uri	string	URI of the Spark manager
cluster_work_dir	path	The cluster work directory where the manager is running
worker_id	string	Identifier (usually an index) for the worker.

Name	Type	Description
spark_uri	string	URI of the Spark manager
cluster_work_fullpath	string	Full path to the cluster work directory where the manager is running
worker_id	string	Identifier (usually an index) for the worker.

Include this module in your Nextflow pipeline:

include { SPARK_WAITFORWORKER } from 'https://github.com/BioImageTools/nextflow-modules/tree/main/modules/bits/spark/waitforworker'