Skip to content

AbstractDeltaCatalog

AbstractDeltaCatalog is a DelegatingCatalogExtension.

AbstractDeltaCatalog is a StagingTableCatalog.

AbstractDeltaCatalog is a SupportsPathIdentifier.

Implementations

DelegatingCatalogExtension

AbstractDeltaCatalog is a DelegatingCatalogExtension (Spark SQL).

createTable

DelegatingCatalogExtension 
createTable(
  ident: Identifier,
  schema: StructType,
  partitions: Array[Transform],
  properties: util.Map[String, String]): Table

createTable is part of the DelegatingCatalogExtension (Spark SQL) abstraction.

createTable...FIXME

loadTable

DelegatingCatalogExtension 
loadTable(
  ident: Identifier): Table

loadTable is part of the DelegatingCatalogExtension (Spark SQL) abstraction.

loadTable setVariantBlockingConfigIfUC.

loadTable...FIXME

StagingTableCatalog

AbstractDeltaCatalog is a StagingTableCatalog (Spark SQL).

isUnityCatalog

isUnityCatalog: Boolean

isUnityCatalog is enabled (true) when the delegate field of this implementation of DelegatingCatalogExtension is a class in io.unitycatalog. package.

In other words, isUnityCatalog is true if the underlying catalog is a Unity Catalog implementation (e.g., io.unitycatalog.spark.UCSingleCatalog).

Lazy Value

isUnityCatalog is a Scala lazy value to guarantee that the code to initialize it is executed once only (when accessed for the first time) and the computed value never changes afterwards.

Learn more in the Scala Language Specification.

setVariantBlockingConfigIfUC

setVariantBlockingConfigIfUC(): Unit

Only when executed in isUnityCatalog mode, setVariantBlockingConfigIfUC sets the internal spark.databricks.delta.variant.disableVariantTableFeatureForSpark40 configuration property to true.

setVariantBlockingConfigIfUC is used when: