ResourceProfileManager¶

Creating Instance¶

ResourceProfileManager takes the following to be created:

• SparkConf
• LiveListenerBus

ResourceProfileManager is created when:

• SparkContext is created

Accessing ResourceProfileManager¶

ResourceProfileManager is available to other Spark services using SparkContext.

Default Profile¶

ResourceProfileManager finds the default profile when created and registers it immediately.

addResourceProfile¶

addResourceProfile(
  rp: ResourceProfile): Unit

addResourceProfile...FIXME

addResourceProfile is used when:

• RDD is requested to withResources
• ResourceProfileManager is created
• DAGScheduler is requested to mergeResourceProfilesForStage