FlowResolver¶

Creating Instance¶

FlowResolver takes the following to be created:

• DataflowGraph

FlowResolver is created alongside a CoreDataflowNodeProcessor.

attemptResolveFlow¶

attemptResolveFlow(
  flowToResolve: UnresolvedFlow,
  allInputs: Set[TableIdentifier],
  availableResolvedInputs: Map[TableIdentifier, Input]): ResolvedFlow

attemptResolveFlow...FIXME

attemptResolveFlow is used when:

• CoreDataflowNodeProcessor is requested to processUnresolvedFlow

resolveFlow¶

resolveFlow(
  flow: UnresolvedFlow,
  funcResult: FlowFunctionResult): ResolvedFlow

resolveFlow resolves the given UnresolvedFlow as follows:

• For AutoCdcFlow, resolveFlow creates a AutoCdcMergeFlow.
• For UntypedFlow, resolveFlow transformUntypedFlowToResolvedFlow.

transformUntypedFlowToResolvedFlow¶

transformUntypedFlowToResolvedFlow(
  flow: UntypedFlow,
  funcResult: FlowFunctionResult): ResolvedFlow

transformUntypedFlowToResolvedFlow resolves the given UntypedFlow as follows (and in that order):

• AppendOnceFlow for a once flow
• StreamingFlow for the given FlowFunctionResult with a streaming DataFrame
• CompleteFlow, otherwise