ExecutorMetrics¶

ExecutorMetrics is a collection of executor metrics.

Creating Instance¶

ExecutorMetrics takes the following to be created:

• Metrics

ExecutorMetrics is created when:

• SparkContext is requested to reportHeartBeat
• DAGScheduler is requested to post a SparkListenerTaskEnd event
• ExecutorMetricsPoller is requested to getExecutorUpdates
• ExecutorMetricsJsonDeserializer is requested to deserialize
• JsonProtocol is requested to executorMetricsFromJson

Current Metric Values¶

getCurrentMetrics(
  memoryManager: MemoryManager): Array[Long]

getCurrentMetrics gives metric values for every metric getter.

Given that one metric getter (type) can report multiple metrics, the length of the result collection is the number of metrics (and at least the number of metric getters). The order matters and is exactly as metricGetters.

getCurrentMetrics is used when:

• SparkContext is requested to reportHeartBeat
• ExecutorMetricsPoller is requested to poll