Skip to content

Spark Configuration Properties of External Shuffle Service

The following are configuration properties of External Shuffle Service.


Whether to use db in ExternalShuffleService. Note that this only affects standalone mode.

Default: true

Used when:


Controls whether to use the External Shuffle Service

Default: false


LocalSparkCluster turns this property off explicitly when started.

Used when:


Enables ExternalShuffleService for fetching disk persisted RDD blocks.

When enabled with Dynamic Resource Allocation executors having only disk persisted blocks are considered idle after spark.dynamicAllocation.executorIdleTimeout and will be released accordingly.

Default: false

Used when:


Port of the external shuffle service

Default: 7337

Used when: