Skip to content

ExecutorAllocationManagerSource -- Metric Source for Dynamic Allocation

ExecutorAllocationManagerSource is a[metric source] for[] with name ExecutorAllocationManager and the following gauges:

  • executors/numberExecutorsToAdd which exposes[numExecutorsToAdd].
  • executors/numberExecutorsPendingToRemove which corresponds to the number of elements in[executorsPendingToRemove].
  • executors/numberAllExecutors which corresponds to the number of elements in[executorIds].
  • executors/numberTargetExecutors which is[numExecutorsTarget].
  • executors/numberMaxNeededExecutors which simply calls[maxNumExecutorsNeeded].

NOTE: Spark uses[Metrics] Java library to expose internal state of its services to measure.

Last update: 2020-10-06