Skip to content

DeltaGenerateCommand

= DeltaGenerateCommand -- Executing Generation Functions On Delta Tables

DeltaGenerateCommand is a concrete <> (and so can <>) that can <>.

[[symlink_format_manifest]] DeltaGenerateCommand supports symlink_format_manifest only for the <>.

[source,text]

val generateQ = """GENERATE symlink_format_manifest for table delta./tmp/delta/t1""" scala> sql(generateQ).foreach(_ => ())


[[modeNameToGenerationFunc]] DeltaGenerateCommand uses a lookup table for generation functions per mode:

  • Uses <> for the only-supported <>

DeltaGenerateCommand is <> when:

  • DeltaSqlAstBuilder is requested to <>

  • <> operator is used (that <>)

== [[creating-instance]] Creating DeltaGenerateCommand Instance

DeltaGenerateCommand takes the following to be created:

  • [[modeName]] Mode (<> is the only supported mode)
  • [[tableId]] Delta table (TableIdentifier)

== [[run]] Running Command -- run Method

[source, scala]

run(sparkSession: SparkSession): Seq[Row]

NOTE: run is part of the RunnableCommand contract to...FIXME.

run <> for the <> (from the <>).

run finds the generate function for the mode (in the <> registry) and applies (executes) it to the DeltaLog.

run throws an AnalysisException when the <> of the <> of the DeltaLog is negative (less than 0):

Delta table not found at [tablePath].

run throws an IllegalArgumentException for unsupported <>:

Specified mode '[modeName]' is not supported. Supported modes are: symlink_format_manifest

Last update: 2020-09-24