Skip to content

StageInfo

StageInfo is a metadata about a stage to pass from the scheduler to SparkListeners.

Creating Instance

StageInfo takes the following to be created:

StageInfo is created when:

fromStage Utility

fromStage(
  stage: Stage,
  attemptId: Int,
  numTasks: Option[Int] = None,
  taskMetrics: TaskMetrics = null,
  taskLocalityPreferences: Seq[Seq[TaskLocation]] = Seq.empty): StageInfo

fromStage...FIXME

fromStage is used when:


Last update: 2020-12-30