ResultStage is the final stage in a job that applies a function on one or many partitions of the target RDD to compute the result of an action.
The partitions are given as a collection of partition ids (
partitions) and the function
func: (TaskContext, Iterator[_]) => _.
== [[findMissingPartitions]] Finding Missing Partitions
NOTE: findMissingPartitions is part of the scheduler:Stage.md#findMissingPartitions[Stage] abstraction.
.ResultStage.findMissingPartitions and ActiveJob image::resultstage-findMissingPartitions.png[align="center"]
In the above figure, partitions 1 and 2 are not finished (
F is false while
T is true).
activeJob returns the optional
ActiveJob associated with a
CAUTION: FIXME When/why would that be