DeltaSourceUtils¶

delta.generationExpression¶

DeltaSourceUtils defines delta.generationExpression metadata key for the generation expression of a generated column of a delta table.

Used when:

• DeltaColumnBuilder is requested to build a StructField
• ColumnWithDefaultExprUtils is requested to removeDefaultExpressions
• GeneratedColumn utility is used to isGeneratedColumn and getGenerationExpressionStr
• SchemaUtils utility is used to reportDifferences

delta.identity.allowExplicitInsert¶

delta.identity.allowExplicitInsert metadata key is used when:

• ColumnWithDefaultExprUtils utility is used to isIdentityColumn and removeDefaultExpressions

delta.identity.start¶

delta.identity.start table metadata key is used when:

• ColumnWithDefaultExprUtils is used to isIdentityColumn and removeDefaultExpressions
• DeltaColumnBuilder is requested to build a StructField (with identityAllowExplicitInsert defined)
• IdentityColumn is used to getIdentityInfo

delta.identity.highWaterMark¶

delta.identity.highWaterMark table metadata key is used when:

• ColumnWithDefaultExprUtils is used to removeDefaultExpressions
• IdentityColumn is requested to getIdentityInfo and updateToValidHighWaterMark

delta.identity.step¶

DeltaSourceUtils defines delta.identity.step metadata key for...FIXME

Used when:

• ColumnWithDefaultExprUtils utility is used to isIdentityColumn and removeDefaultExpressions

isDeltaDataSourceName¶

isDeltaDataSourceName(
  name: String): Boolean

isDeltaDataSourceName returns true when the given name is delta (case-insensitively).

isDeltaDataSourceName is used when:

• DeltaTableUtils is requested to isValidPath
• DeltaUnsupportedOperationsCheck is requested to fail (to throw an DeltaAnalysisException)
• DeltaCatalog is requested to createTable, stageReplace, stageCreateOrReplace, stageCreate
• SupportsPathIdentifier is requested to hasDeltaNamespace
• ConvertToDeltaCommandBase is requested to isPathIdentifier
• DeltaCommand is requested to isPathIdentifier
• DeltaSourceUtils is requested to isDeltaTable