V2SessionCatalog¶

V2SessionCatalog is a TableCatalog that makes the good ol' SessionCatalog available in the modern Catalog Plugin API-based infrastructure.

V2SessionCatalog is known under the name of spark_catalog.

V2SessionCatalog is a SupportsNamespaces.

V2SessionCatalog is the default session catalog of CatalogManager.

Creating Instance¶

V2SessionCatalog takes the following to be created:

• SessionCatalog
• SQLConf

V2SessionCatalog is created when:

• BaseSessionStateBuilder is requested for one

capabilities¶

capabilities(): Set[TableCatalogCapability]

capabilities is SUPPORT_COLUMN_DEFAULT_VALUE.

Default Namespace¶

defaultNamespace: Array[String]

defaultNamespace is default.

Name¶

name: String

The name of V2SessionCatalog is spark_catalog.

Loading Table¶

loadTable(
  ident: Identifier): Table

loadTable creates a V1Table for a table metadata (from the SessionCatalog).

Loading Function¶

loadFunction(
  ident: Identifier): UnboundFunction

loadFunction...FIXME

Creating Table¶

createTable(
  ident: Identifier,
  columns: Array[Column],
  partitions: Array[Transform],
  properties: Map[String, String]): Table
createTable(
  ident: Identifier,
  schema: StructType,
  partitions: Array[Transform],
  properties: util.Map[String, String]): Table // (1)!

createTable creates a CatalogTable and requests the SessionCatalog to createTable (with ignoreIfExists flag disabled so when the table already exists a TableAlreadyExistsException is reported).

In the end, createTable loads the table.