AcceptsLatestSeenOffsetHandler¶

AcceptsLatestSeenOffsetHandler is a utility that can setLatestSeenOffsetOnSources on SparkDataStreams with support for AcceptsLatestSeenOffset.

setLatestSeenOffsetOnSources¶

setLatestSeenOffsetOnSources(
  offsets: Option[OffsetSeq],
  sources: Seq[SparkDataStream]): Unit

setLatestSeenOffsetOnSources...FIXME

setLatestSeenOffsetOnSources is used when:

• MicroBatchExecution is requested to run an activated streaming query (and the currentBatchId has not been initialized yet)
• ContinuousExecution is requested to run a streaming query in continuous mode (and the currentBatchId has been initialized already)