Skip to content

Configuration Properties

spark.metrics.appStatusSource.enabled

Enables Dropwizard/Codahale metrics with the status of a live Spark application

Default: false

Used when:

spark.metrics.conf

The metrics configuration file

Default: metrics.properties

spark.metrics.executorMetricsSource.enabled

Enables registering ExecutorMetricsSource with the metrics system

Default: true

Used when:

spark.metrics.namespace

Root namespace for metrics reporting

Default: Spark Application ID (i.e. spark.app.id configuration property)

Since a Spark application's ID changes with every execution of a Spark application, a custom namespace can be specified for an easier metrics reporting.

Used when MetricsSystem is requested for a metrics source identifier (metrics namespace)

spark.metrics.staticSources.enabled

Enables static metric sources

Default: true

Used when: