Skip to content

CreateStreamingTableAsSelect Binary Logical Command

CreateStreamingTableAsSelect is a CreatePipelineDatasetAsSelect binary logical command that represents CREATE STREAMING TABLE AS (Spark SQL) SQL statement in Spark Declarative Pipelines framework.

CreateStreamingTableAsSelect is handled by SqlGraphRegistrationContext.

CreateStreamingTable for CREATE STREAMING TABLE SQL Statement

CREATE STREAMING TABLE SQL statement (with no AS clause) gives a CreateStreamingTable unary logical command.

Creating Instance

CreateStreamingTableAsSelect takes the following to be created:

  • Name (LogicalPlan (Spark SQL))
  • Colums (ColumnDefinitions)
  • Partitioning (Transforms (Spark SQL))
  • TableSpecBase
  • CREATE query (LogicalPlan (Spark SQL))
  • Original SQL Text
  • ifNotExists flag

CreateStreamingTableAsSelect is created when:

  • SparkSqlAstBuilder (Spark SQL) is requested to parse CREATE STREAMING TABLE AS SQL statement