ExecutorMetrics is a collection of executor metrics.
ExecutorMetrics takes the following to be created:
ExecutorMetrics is created when:
SparkContextis requested to reportHeartBeat
DAGScheduleris requested to post a SparkListenerTaskEnd event
ExecutorMetricsPolleris requested to getExecutorUpdates
ExecutorMetricsJsonDeserializeris requested to
JsonProtocolis requested to executorMetricsFromJson
Current Metric Values¶
getCurrentMetrics( memoryManager: MemoryManager): Array[Long]
Given that one metric getter (type) can report multiple metrics, the length of the result collection is the number of metrics (and at least the number of metric getters). The order matters and is exactly as metricGetters.
getCurrentMetrics is used when: