SparkStatusTracker¶
SparkStatusTracker is created for SparkContext for Spark developers to access the AppStatusStore and the following:
- All active job IDs
- All active stage IDs
- All known job IDs (and possibly limited to a particular job group)
SparkExecutorInfos of all known executorsSparkJobInfoof a job IDSparkStageInfoof a stage ID
Creating Instance¶
SparkStatusTracker takes the following to be created:
- SparkContext (unused)
- AppStatusStore
SparkStatusTracker is created when:
SparkContextis created