Skip to content

KubernetesClusterManager

KubernetesClusterManager is an ExternalClusterManager for k8s master URLs.

Creating TaskScheduler

createTaskScheduler(
  sc: SparkContext,
  masterURL: String): TaskScheduler

createTaskScheduler creates a TaskSchedulerImpl.

createTaskScheduler is part of the ExternalClusterManager abstraction.

Creating SchedulerBackend

createSchedulerBackend(
  sc: SparkContext,
  masterURL: String,
  scheduler: TaskScheduler): SchedulerBackend

createSchedulerBackend...FIXME

createSchedulerBackend is part of the ExternalClusterManager abstraction.

Initializing Scheduling Components

initialize(
  scheduler: TaskScheduler,
  backend: SchedulerBackend): Unit

initialize requests the given TaskSchedulerImpl to initialize with the given SchedulerBackend.

initialize is part of the ExternalClusterManager abstraction.


Last update: 2020-10-10