DriverPluginContainer¶

DriverPluginContainer is a PluginContainer.

Creating Instance¶

DriverPluginContainer takes the following to be created:

• SparkContext
• Resources (Map[String, ResourceInformation])
• SparkPlugins

DriverPluginContainer is created when:

• PluginContainer utility is used for a PluginContainer (at SparkContext startup)

Registering Metrics¶

registerMetrics(
  appId: String): Unit

registerMetrics is part of the PluginContainer abstraction.

For every driver plugin, registerMetrics requests it to register metrics and the associated PluginContextImpl for the same.

Logging¶

Enable ALL logging level for org.apache.spark.internal.plugin.DriverPluginContainer logger to see what happens inside.

Add the following line to conf/log4j.properties:

log4j.logger.org.apache.spark.internal.plugin.DriverPluginContainer=ALL

Refer to Logging.