UniversalFormat¶

hudiEnabled¶

hudiEnabled(
  metadata: Metadata): Boolean

hudiEnabled is enabled (true) when hudi is listed in delta.universalFormat.enabledFormats table property (in the given Metadata).

hudiEnabled is used when:

• HudiConverter is requested to convertSnapshot, enqueueSnapshotForConversion
• UniversalFormat is requested to enforceHudiDependencies
• CreateDeltaTableCommand is requested to runPostCommitUpdates
• HudiConverterHook post-commit hook is executed

icebergEnabled¶

icebergEnabled(
  metadata: Metadata): Boolean
icebergEnabled(
  properties: Map[String, String]): Boolean

icebergEnabled is enabled (true) when iceberg is listed in delta.universalFormat.enabledFormats table property (in the given Metadata or the properties).

icebergEnabled is used when:

• CreateDeltaTableCommand is requested to runPostCommitUpdates
• IcebergConverter is requested to enqueueSnapshotForConversion
• IcebergConverterHook post-commit hook is executed
• UniversalFormat is requested to enforceIcebergInvariantsAndDependencies, enforceSupportInCatalog
• ReorgTableForUpgradeUniformHelper is requested to doRewrite

enforceIcebergInvariantsAndDependencies¶

enforceIcebergInvariantsAndDependencies(
  snapshot: Snapshot,
  newestProtocol: Protocol,
  newestMetadata: Metadata,
  isCreatingOrReorg: Boolean,
  actions: Seq[Action]): (Option[Protocol], Option[Metadata])

enforceIcebergInvariantsAndDependencies...FIXME

enforceIcebergInvariantsAndDependencies is used when:

• UniversalFormat is requested to enforceInvariantsAndDependencies

enforceDependenciesInConfiguration¶

enforceDependenciesInConfiguration(
  configuration: Map[String, String],
  snapshot: Snapshot): Map[String, String]

enforceDependenciesInConfiguration...FIXME

enforceDependenciesInConfiguration is used when:

• CreateDeltaTableCommand is requested to handleCreateTable and handleCreateTableAsSelect

enforceInvariantsAndDependencies¶

enforceInvariantsAndDependencies(
  snapshot: Snapshot,
  newestProtocol: Protocol,
  newestMetadata: Metadata,
  isCreatingOrReorgTable: Boolean,
  actions: Seq[Action]): (Option[Protocol], Option[Metadata])

enforceInvariantsAndDependencies...FIXME

enforceInvariantsAndDependencies is used when:

• OptimisticTransactionImpl is requested to prepare a commit
• UniversalFormat is requested to enforceDependenciesInConfiguration

enforceHudiDependencies¶

enforceHudiDependencies(
  newestMetadata: Metadata,
  snapshot: Snapshot): Any

enforceHudiDependencies...FIXME