Skip to content

DeltaSink

DeltaSink is the Sink (Spark Structured Streaming) of the delta data source for streaming queries.

Creating Instance

DeltaSink takes the following to be created:

DeltaSink is created when:

DeltaLog

deltaLog: DeltaLog

deltaLog is a DeltaLog that is created for the delta table when DeltaSink is created.

deltaLog is used when:

Adding Streaming Micro-Batch

addBatch(
  batchId: Long,
  data: DataFrame): Unit

addBatch is part of the Sink (Spark Structured Streaming) abstraction.

addBatch requests the DeltaLog to start a new transaction.

addBatch...FIXME

In the end, addBatch requests the OptimisticTransaction to commit.

Text Representation

toString(): String

DeltaSink uses the following text representation (with the path):

DeltaSink[path]

ImplicitMetadataOperation

DeltaSink is an ImplicitMetadataOperation.


Last update: 2021-03-18
Back to top