ResourceProfileManager¶
Creating Instance¶
ResourceProfileManager
takes the following to be created:
ResourceProfileManager
is created when:
SparkContext
is created
Accessing ResourceProfileManager¶
ResourceProfileManager
is available to other Spark services using SparkContext.
Default Profile¶
ResourceProfileManager
finds the default profile when created and registers it immediately.
addResourceProfile¶
addResourceProfile(
rp: ResourceProfile): Unit
addResourceProfile
...FIXME
addResourceProfile
is used when:
RDD
is requested to withResourcesResourceProfileManager
is createdDAGScheduler
is requested to mergeResourceProfilesForStage