Skip to content

ResourceProfile

ResourceProfile is a resource profile (with executor and task requirements) for Stage Level Scheduling.

ResourceProfile is a Java Serializable.

Creating Instance

ResourceProfile takes the following to be created:

  • Executor Resources (Map[String, ExecutorResourceRequest])
  • Task Resources (Map[String, TaskResourceRequest])

ResourceProfile is created (directly or using getOrCreateDefaultProfile) when:

getOrCreateDefaultProfile Utility

getOrCreateDefaultProfile(
  conf: SparkConf): ResourceProfile

getOrCreateDefaultProfile...FIXME

getOrCreateDefaultProfile is used when:


Last update: 2020-12-04