Skip to content

CreateStreamingTable Unary Logical Command

CreateStreamingTable is a UnaryCommand (Spark SQL) and a CreatePipelineDataset that represents CREATE STREAMING TABLE (Spark SQL) SQL statement (with no AS clause) in Spark Declarative Pipelines framework.

CreateStreamingTable is handled by SqlGraphRegistrationContext.

CreateStreamingTableAsSelect for CREATE STREAMING TABLE AS SQL Statement

CREATE STREAMING TABLE AS SQL statement (with AS clause) gives a CreateStreamingTableAsSelect binary logical command.

Creating Instance

CreateStreamingTable takes the following to be created:

  • Name (LogicalPlan (Spark SQL))
  • Columns (ColumnDefinitions)
  • Partitioning (Transforms (Spark SQL))
  • TableSpecBase
  • ifNotExists flag

CreateStreamingTable is created when:

  • SparkSqlAstBuilder (Spark SQL) is requested to parse CREATE STREAMING TABLE SQL statement