Skip to content

= FsHistoryProvider

FsHistoryProvider is the default[ApplicationHistoryProvider] for[Spark History Server].

FsHistoryProvider is <> exclusively when HistoryServer is[started] as a standalone application and spark.history.provider configuration property was not defined.


Enable INFO or DEBUG logging levels for org.apache.spark.deploy.history.FsHistoryProvider logger to see what happens inside.

Add the following line to conf/

Refer to[Logging].

== [[rebuildAppStore]] rebuildAppStore Internal Method

[source, scala]

rebuildAppStore( store: KVStore, eventLog: FileStatus, lastUpdated: Long): Unit


NOTE: rebuildAppStore is used when...FIXME

== [[getAppUI]] getAppUI Method

[source, scala]

getAppUI(appId: String, attemptId: Option[String]): Option[LoadedAppUI]

NOTE: getAppUI is part of[ApplicationHistoryProvider Contract] to...FIXME.


== [[creating-instance]] Creating FsHistoryProvider Instance

FsHistoryProvider takes the following when created:

  • [[conf]][SparkConf]
  • [[clock]] Clock (default: SystemClock)

FsHistoryProvider initializes the <>.

Last update: 2020-10-06