Tracker¶

Tracker is a private internal class of ExecutorMonitor.

Creating Instance¶

Tracker takes the following to be created:

• resourceProfileId

Tracker is created when:

• ExecutorMonitor is requested to ensureExecutorIsTracked

cachedBlocks Internal Registry¶

cachedBlocks: Map[Int, BitSet]

Tracker uses cachedBlocks internal registry for cached blocks (RDD IDs and partition IDs stored in an executor).

cachedBlocks is used when:

• ExecutorMonitor is requested to onBlockUpdated, onUnpersistRDD
• Tracker is requested to updateTimeout

removeShuffle¶

removeShuffle(
  id: Int): Unit

removeShuffle...FIXME

removeShuffle is used when:

• ExecutorMonitor is requested to cleanupShuffle

updateActiveShuffles¶

updateActiveShuffles(
  ids: Iterable[Int]): Unit

updateActiveShuffles...FIXME

updateActiveShuffles is used when:

• ExecutorMonitor is requested to onJobStart and onJobEnd

updateRunningTasks¶

updateRunningTasks(
  delta: Int): Unit

updateRunningTasks...FIXME

updateRunningTasks is used when:

• ExecutorMonitor is requested to onTaskStart, onTaskEnd and onExecutorAdded

updateTimeout¶

updateTimeout(): Unit

updateTimeout...FIXME

updateTimeout is used when:

• ExecutorMonitor is requested to onBlockUpdated and onUnpersistRDD
• Tracker is requested to updateRunningTasks, removeShuffle, updateActiveShuffles