Sink¶

Sink is an extension of the GraphElement and Output abstractions for pipeline sinks that can define their write format and options.

A sink is a generic target for a flow to send data that is external to a pipeline.

Sinks are not registered in a Spark catalog.

Contract¶

Format¶

format: String

Used when:

• PipelinesHandler is requested to define a sink (output)
• SinkWrite is requested to start a stream

Options¶

options: Map[String, String]

Used when:

• PipelinesHandler is requested to define a sink (output)
• SinkWrite is requested to start a stream

Implementations¶

• SinkImpl