ExecutorData¶
ExecutorData
is a metadata of an executor:
- Executor's RPC Endpoint
- Executor's RpcAddress
- Executor's Host
- Executor's Free Cores
- Executor's Total Cores
- Executor's Log URLs (
Map[String, String]
) - Executor's Attributes (
Map[String, String]
) - Executor's Resources Info (
Map[String, ExecutorResourceInfo]
) - Executor's ResourceProfile ID
ExecutorData
is created for every executor registered (when DriverEndpoint
is requested to handle a RegisterExecutor message).
ExecutorData
is used by CoarseGrainedSchedulerBackend
to track registered executors.
Note
ExecutorData
is posted as part of SparkListenerExecutorAdded event by DriverEndpoint every time an executor is registered.