Skip to content

ExecutorData

ExecutorData is a metadata of an executor:

  • Executor's RPC Endpoint
  • Executor's RpcAddress
  • Executor's Host
  • Executor's Free Cores
  • Executor's Total Cores
  • Executor's Log URLs (Map[String, String])
  • Executor's Attributes (Map[String, String])
  • Executor's Resources Info (Map[String, ExecutorResourceInfo])
  • Executor's ResourceProfile ID

ExecutorData is created for every executor registered (when DriverEndpoint is requested to handle a RegisterExecutor message).

ExecutorData is used by CoarseGrainedSchedulerBackend to track registered executors.

Note

ExecutorData is posted as part of SparkListenerExecutorAdded event by DriverEndpoint every time an executor is registered.