Skip to content

SparkDataStream

SparkDataStream is an abstraction of readable data streams.

Contract

commit

void commit(
  Offset end)

Used when:

  • ContinuousExecution stream execution engine is requested to commit
  • MicroBatchExecution stream execution engine is requested to constructNextBatch

deserializeOffset

Offset deserializeOffset(
  String json)

Used when:

initialOffset

Offset initialOffset()

Used when:

stop

void stop()

Used when:

Implementations