Deploy Mode

Deploy mode specifies the location of where driver executes in the deployment environment.

Deploy mode can be one of the following options:

  • client (default) - the driver runs on the machine that the Spark application was launched.

  • cluster - the driver runs on a random node in a cluster.

cluster deploy mode is only available for non-local cluster deployments.

You can control the deploy mode of a Spark application using spark-submit’s --deploy-mode command-line option or spark.submit.deployMode Spark property.

spark.submit.deployMode setting can be client or cluster.

Client Deploy Mode

FIXME

Cluster Deploy Mode

FIXME

spark.submit.deployMode

spark.submit.deployMode (default: client) can be client or cluster.