Skip to content

StagedDeltaTableV2

StagedDeltaTableV2 is a StagedTable (Spark SQL) that SupportsWrite (Spark SQL).

Creating Instance

StagedDeltaTableV2 takes the following to be created:

  • Identifier
  • Schema
  • Partitions (Array[Transform])
  • Properties
  • Operation

StagedDeltaTableV2 is created when:

CreationMode

StagedDeltaTableV2 is given a CreationMode when created.

TableCreationModes AbstractDeltaCatalog's Operation
Create stageCreate
CreateOrReplace stageCreateOrReplace
Replace stageReplace

commitStagedChanges

StagedTable 
commitStagedChanges(): Unit

commitStagedChanges is part of the StagedTable (Spark SQL) abstraction.

commitStagedChanges getTablePropsAndWriteOptions from this properties.

commitStagedChanges...FIXME

commitStagedChanges expandTableProps.

When in Unity Catalog execution mode, commitStagedChanges translateUCTableIdProperty.

In the end, commitStagedChanges createDeltaTable.

Creating WriteBuilder

SupportsWrite 
newWriteBuilder(
  info: LogicalWriteInfo): WriteBuilder

newWriteBuilder is part of the SupportsWrite (Spark SQL) abstraction.

newWriteBuilder creates a DeltaV1WriteBuilder (with the options of the given LogicalWriteInfo).