= ShuffleMetricsSource

ShuffleMetricsSource is the[metrics source] of a[] for <>.

ShuffleMetricsSource lives on a Spark executor and is[registered only when a Spark application runs in a non-local / cluster mode].

.Registering ShuffleMetricsSource with "executor" MetricsSystem image::ShuffleMetricsSource.png[align="center"]

== [[creating-instance]] Creating Instance

ShuffleMetricsSource takes the following to be created:

  • <>
  • <>

ShuffleMetricsSource is created when BlockManager is requested for the[shuffle metrics source].

== [[metricSet]] MetricSet

ShuffleMetricsSource is given a Dropwizard Metrics[MetricSet] when <>.

The MetricSet is requested from the[ShuffleClient] (of[BlockManager]).

== [[sourceName]] Source Name

ShuffleMetricsSource is given a name when <> that is one of the following:

  • NettyBlockTransfer when[spark.shuffle.service.enabled] configuration property is off (false)

  • ExternalShuffle when[spark.shuffle.service.enabled] configuration property is on (true)

Last update: 2020-10-06