Skip to content

StreamingFlow

StreamingFlow is a ResolvedFlow that may or may not be append.

StreamingFlow represents an UnresolvedFlow with a streaming dataframe in a dataflow graph.

StreamingFlow is planned for execution as StreamingTableWrite (assuming that the Output of this flow's destination is a Table).

Creating Instance

StreamingFlow takes the following to be created:

StreamingFlow is created when:

mustBeAppend Flag

mustBeAppend: Boolean

StreamingFlow is given mustBeAppend flag when created.

Default: false

The value of mustBeAppend flag is based on whether there are more than one flow to this flow's destination in a dataflow graph or not.

When enabled (true), this UnresolvedFlow is planned for execution with the Append output mode (as the other flows will then get their results overwritten).

StreamingTableWrite ignores mustBeAppend

StreamingFlow is planned for execution as StreamingTableWrite with no execution differences based on the mustBeAppend flag.