SparkStatusTracker¶
SparkStatusTracker
is created for SparkContext for Spark developers to access the AppStatusStore and the following:
- All active job IDs
- All active stage IDs
- All known job IDs (and possibly limited to a particular job group)
SparkExecutorInfo
s of all known executorsSparkJobInfo
of a job IDSparkStageInfo
of a stage ID
Creating Instance¶
SparkStatusTracker
takes the following to be created:
- SparkContext (unused)
- AppStatusStore
SparkStatusTracker
is created when:
SparkContext
is created