Skip to content

CreateFlowCommand Binary Logical Operator

CreateFlowCommand is a BinaryCommand logical operator that represents CREATE FLOW ... AS INSERT INTO ... BY NAME (Spark SQL) SQL statement in Spark Declarative Pipelines.

CreateFlowCommand is handled by SqlGraphRegistrationContext.

Pipelines execution planning strategy is used to prevent direct execution of Spark Declarative Pipelines SQL stataments.

Creating Instance

CreateFlowCommand takes the following to be created:

  • Name (UnresolvedIdentifier leaf logical operator)
  • Flow operation (InsertIntoStatement (Spark SQL) unary logical operator)
  • Comment (optional)

CreateFlowCommand is created when:

  • SparkSqlAstBuilder (Spark SQL) is requested to parse CREATE FLOW AS INSERT INTO BY NAME SQL statement