Skip to content

Configuration Properties of Spark Standalone

spark.deploy.spreadOut

Controls whether standalone Master should perform round-robin scheduling across worker nodes (spreading out each app among all the nodes) instead of trying to consolidate each app onto a small number of nodes

Default: true

spark.worker.resourcesFile

(internal) Path to a file containing the resources allocated to the worker. The file should be formatted as a JSON array of ResourceAllocation objects. Only used internally in standalone mode.

Default: (undefined)

Used when:

  • LocalSparkCluster is requested to start
  • Worker standalone application is launched

Last update: 2020-12-17