StreamingFlow¶

StreamingFlow is a ResolvedFlow that may or may not be append.

StreamingFlow represents an UnresolvedFlow with a streaming dataframe in a dataflow graph.

StreamingFlow is planned for execution as StreamingTableWrite (assuming that the Output of this flow's destination is a Table).

Creating Instance¶

StreamingFlow takes the following to be created:

• UnresolvedFlow
• FlowFunctionResult
• mustBeAppend flag

StreamingFlow is created when:

• FlowResolver is requested to convertResolvedToTypedFlow (for an UnresolvedFlow with a streaming dataframe)

mustBeAppend Flag¶

mustBeAppend: Boolean

StreamingFlow is given mustBeAppend flag when created.

Default: false

The value of mustBeAppend flag is based on whether there are more than one flow to this flow's destination in a dataflow graph or not.

When enabled (true), this UnresolvedFlow is planned for execution with the Append output mode (as the other flows will then get their results overwritten).