FlowExecution¶

FlowExecution is an abstraction of flow executions (batch or streaming).

FlowExecution can be executed asynchronously.

Contract¶

TableIdentifier¶

identifier: TableIdentifier

Destination¶

destination: Output

Output

See:

• BatchTableWrite
• SinkWrite
• StreamingTableWrite

QueryOrigin¶

getOrigin: QueryOrigin

isStreaming¶

isStreaming: Boolean

See:

• BatchTableWrite
• StreamingFlowExecution

PipelineUpdateContext¶

updateContext: PipelineUpdateContext

PipelineUpdateContext of this flow execution

executeInternal¶

executeInternal(): Future[Unit]

See:

• BatchTableWrite
• StreamingFlowExecution

Used when:

• FlowExecution is requested to execute asynchronously

Implementations¶

• BatchTableWrite
• StreamingFlowExecution

Execute Asynchronously¶

executeAsync(): Unit

executeAsync uses the internal _future to control whether this flow has been executed or not.

executeAsync executeInternal (and stores the result of this execution in the internal _future).

executeAsync is used when:

• GraphExecution is requested to planAndStartFlow

Human-Friendly Display Name¶

displayName: String

displayName is the unquotedString of this TableIdentifier.

displayName is used when:

• SinkWrite is requested to startStream (used for a query name)
• StreamingTableWrite is requested to startStream (used for a query name)
• GraphExecution is requested to stop an execution of a flow (used for error reporting)
• FlowProgressEventLogger is requested to record a start of an execution of a flow (used for error reporting)