JsonProtocol Utility

JsonProtocol is an utility to convert SparkListenerEvents to and from JSON format.

JsonProtocol is used by EventLoggingListener and ReplayListenerBus (to log and replay events for Spark History Server, respectively).

sparkEventFromJson Utility

sparkEventFromJson(
  json: JValue): SparkListenerEvent

sparkEventFromJson…​FIXME

sparkEventFromJson is used when ReplayListenerBus is requested to replay.

logStartToJson Utility

logStartToJson(
  logStart: SparkListenerLogStart): JValue

logStartToJson…​FIXME

logStartToJson is used when…​FIXME

taskEndFromJson Utility

taskEndFromJson(
  json: JValue): SparkListenerTaskEnd

taskEndFromJson…​FIXME

taskEndFromJson is used when JsonProtocol utility is used to sparkEventFromJson.

executorMetricsUpdateFromJson Utility

executorMetricsUpdateFromJson(
  json: JValue): SparkListenerExecutorMetricsUpdate

executorMetricsUpdateFromJson…​FIXME

executorMetricsUpdateFromJson is used when JsonProtocol utility is used to sparkEventFromJson.

taskEndReasonFromJson Utility

taskEndReasonFromJson(
  json: JValue): TaskEndReason

taskEndReasonFromJson…​FIXME

taskEndReasonFromJson is used when JsonProtocol utility is used to taskEndFromJson.

stageInfoFromJson Utility

stageInfoFromJson(
  json: JValue): StageInfo

stageInfoFromJson…​FIXME

stageInfoFromJson is used when JsonProtocol utility is used to jobStartFromJson, stageSubmittedFromJson, stageCompletedFromJson.

taskInfoFromJson Utility

taskInfoFromJson(
  json: JValue): TaskInfo

taskInfoFromJson…​FIXME

taskInfoFromJson is used when JsonProtocol utility is used to taskStartFromJson, taskGettingResultFromJson, taskEndFromJson.

accumulableInfoFromJson Utility

accumulableInfoFromJson(
  json: JValue): AccumulableInfo

accumulableInfoFromJson…​FIXME

accumulableInfoFromJson is used when JsonProtocol utility is used to taskEndReasonFromJson, executorMetricsUpdateFromJson, stageInfoFromJson, taskInfoFromJson.

accumValueFromJson Utility

accumValueFromJson(
  name: Option[String],
  value: JValue): Any

accumValueFromJson…​FIXME

accumValueFromJson is used when JsonProtocol utility is used to accumulableInfoFromJson.

taskMetricsFromJson Utility

taskMetricsFromJson(
  json: JValue): TaskMetrics

taskMetricsFromJson…​FIXME

taskMetricsFromJson is used when JsonProtocol utility is used to taskEndFromJson and taskEndReasonFromJson.

taskEndToJson Utility

taskEndToJson(
  taskEnd: SparkListenerTaskEnd): JValue

taskEndToJson…​FIXME

taskEndToJson is used when JsonProtocol utility is used to convert a SparkListenerEvent to JSON (serialize a SparkListenerEvent to JSON).

taskMetricsToJson Utility

taskMetricsToJson(
  taskMetrics: TaskMetrics): JValue

taskMetricsToJson…​FIXME

taskMetricsToJson is used when JsonProtocol utility is used to taskEndToJson.

blockUpdateFromJson Utility

blockUpdateFromJson(
  json: JValue): SparkListenerBlockUpdated

blockUpdateFromJson…​FIXME

blockUpdateFromJson is used when JsonProtocol utility is used to sparkEventFromJson.

blockUpdatedInfoFromJson Utility

blockUpdatedInfoFromJson(
  json: JValue): BlockUpdatedInfo

blockUpdatedInfoFromJson…​FIXME

blockUpdatedInfoFromJson is used when JsonProtocol utility is used to blockUpdateFromJson.