HistoryAppStatusStore¶

HistoryAppStatusStore is an AppStatusStore for SparkUIs in Spark History Server.

Creating Instance¶

HistoryAppStatusStore takes the following to be created:

• SparkConf
• KVStore

HistoryAppStatusStore is created when:

• FsHistoryProvider is requested for a SparkUI (of a Spark application)

ExecutorLogUrlHandler¶

logUrlHandler: ExecutorLogUrlHandler

HistoryAppStatusStore creates an ExecutorLogUrlHandler (for the logUrlPattern) when created.

HistoryAppStatusStore uses it when requested to replaceLogUrls.

executorList¶

executorList(
  exec: v1.ExecutorSummary,
  urlPattern: String): v1.ExecutorSummary

executorList...FIXME

executorList is part of the AppStatusStore abstraction.

executorSummary¶

executorSummary(
  executorId: String): v1.ExecutorSummary

executorSummary...FIXME

executorSummary is part of the AppStatusStore abstraction.

replaceLogUrls¶

replaceLogUrls(
  exec: v1.ExecutorSummary,
  urlPattern: String): v1.ExecutorSummary

replaceLogUrls...FIXME

replaceLogUrls is used when HistoryAppStatusStore is requested to executorList and executorSummary.