ExecutorMetricsPoller¶

Creating Instance¶

ExecutorMetricsPoller takes the following to be created:

• MemoryManager
• spark.executor.metrics.pollingInterval
• ExecutorMetricsSource

ExecutorMetricsPoller is created when:

• Executor is created

executor-metrics-poller¶

ExecutorMetricsPoller creates a ScheduledExecutorService (Java) when created with the spark.executor.metrics.pollingInterval greater than 0.

The ScheduledExecutorService manages 1 daemon thread with executor-metrics-poller name prefix.

The ScheduledExecutorService is requested to poll at every pollingInterval when ExecutorMetricsPoller is requested to start until stop.

poll¶

poll(): Unit

poll...FIXME

poll is used when:

• Executor is requested to reportHeartBeat
• ExecutorMetricsPoller is requested to start