Main¶

Main is the standalone application that is launched from spark-class shell script.

Launching Application¶

void main(
  String[] argsArray)

For org.apache.spark.deploy.SparkSubmit class name, main creates a SparkSubmitCommandBuilder and builds a command (with the SparkSubmitCommandBuilder).

Otherwise, main creates a SparkClassCommandBuilder and builds a command (with the SparkClassCommandBuilder).

In the end, main prepareWindowsCommand or prepareBashCommand based on the operating system it runs on, MS Windows or non-Windows, respectively.

Building Command¶

List<String> buildCommand(
  AbstractCommandBuilder builder,
  Map<String, String> env,
  boolean printLaunchCommand)

buildCommand requests the given AbstractCommandBuilder to build a command.

With printLaunchCommand enabled, buildCommand prints out the command to standard error:

Spark Command: [cmd]
========================================