ShuffleDataIOUtils¶

Loading ShuffleDataIO¶

loadShuffleDataIO(
  conf: SparkConf): ShuffleDataIO

loadShuffleDataIO uses the spark.shuffle.sort.io.plugin.class configuration property to load the ShuffleDataIO.

loadShuffleDataIO is used when:

• SparkContext is created
• SortShuffleManager utility is used to loadShuffleExecutorComponents