SparkPipelines¶

SparkPipelines is a standalone application that is executed using spark-pipelines shell script.

SparkPipelines is a Scala "launchpad" to execute pyspark/pipelines/cli.py Python script (through SparkSubmit).