ShuffleDataIOUtils¶
Loading ShuffleDataIO¶
loadShuffleDataIO(
conf: SparkConf): ShuffleDataIO
loadShuffleDataIO
uses the spark.shuffle.sort.io.plugin.class configuration property to load the ShuffleDataIO.
loadShuffleDataIO
is used when:
SparkContext
is createdSortShuffleManager
utility is used to loadShuffleExecutorComponents