Skip to content

DeltaSourceOffset — Streaming Offset

DeltaSourceOffset is an Offset (Spark Structured Streaming) for DeltaSource.

Creating Instance

DeltaSourceOffset takes the following to be created:

DeltaSourceOffset is created (using apply utility) when:

Creating DeltaSourceOffset

apply(
  reservoirId: String,
  offset: Offset): DeltaSourceOffset
apply(
  reservoirId: String,
  reservoirVersion: Long,
  index: Long,
  isStartingVersion: Boolean): DeltaSourceOffset

apply creates a DeltaSourceOffset (for the version and the given arguments) or converts a SerializedOffset to a DeltaSourceOffset.

apply is used when:

validateSourceVersion

validateSourceVersion(
  json: String): Unit

validateSourceVersion...FIXME

Source Version

DeltaSourceOffset uses 1 for the version (and does not allow changing it).

The version is used when:


Last update: 2021-05-22
Back to top