External Shuffle Service¶

External Shuffle Service is a Spark service to serve RDD and shuffle blocks outside and for Executors.

ExternalShuffleService can be started as a command-line application or automatically as part of a worker node in a Spark cluster (e.g. Spark Standalone).

External Shuffle Service is enabled in a Spark application using spark.shuffle.service.enabled configuration property.