Skip to content

ShuffleFetchCompletionListener

ShuffleFetchCompletionListener is a TaskCompletionListener (that ShuffleBlockFetcherIterator uses to clean up after the owning task is completed).

Creating Instance

ShuffleFetchCompletionListener takes the following to be created:

ShuffleFetchCompletionListener is created when:

  • ShuffleBlockFetcherIterator is created

onTaskCompletion

onTaskCompletion(
  context: TaskContext): Unit

onTaskCompletion is part of the TaskCompletionListener abstraction.

onTaskCompletion requests the ShuffleBlockFetcherIterator (if available) to cleanup.

In the end, onTaskCompletion nulls out the reference to the ShuffleBlockFetcherIterator (to make it available for garbage collection).