DeletionVectorUtils¶

deletionVectorsReadable¶

deletionVectorsReadable(
  snapshot: SnapshotDescriptor,
  newProtocol: Option[Protocol] = None,
  newMetadata: Option[Metadata] = None): Boolean
deletionVectorsReadable(
  protocol: Protocol,
  metadata: Metadata): Boolean

deletionVectorsReadable is enabled (true) when the following all hold:

1. DeletionVectorsTableFeature is supported by the given Protocol
2. The format provider is parquet (in the given Metadata)

deletionVectorsReadable is used when:

• ScanWithDeletionVectors is requested to dvEnabledScanFor
• DeleteCommand is requested to performDelete
• DeletionVectorUtils is requested to isTableDVFree, fileIndexSupportsReadingDVs
• RestoreTableCommand is executed
• StatisticsCollection is requested to recompute

deletionVectorsWritable¶

deletionVectorsWritable(
  snapshot: SnapshotDescriptor,
  newProtocol: Option[Protocol] = None,
  newMetadata: Option[Metadata] = None): Boolean
deletionVectorsWritable(
  protocol: Protocol,
  metadata: Metadata): Boolean

deletionVectorsWritable is enabled (true) when the following all hold:

1. DeletionVectorsTableFeature is supported by the given Protocol
2. delta.enableDeletionVectors is enabled in the table metadata (in the given Metadata)

deletionVectorsWritable is used when:

• OptimisticTransactionImpl is requested to getAssertDeletionVectorWellFormedFunc
• DeleteCommand is executed (and requested to shouldWritePersistentDeletionVectors)

isTableDVFree¶

isTableDVFree(
  spark: SparkSession,
  snapshot: Snapshot): Boolean

isTableDVFree indicates whether Deletion Vectors are present in the delta table (per the given Snapshot).

isTableDVFree is true unless deletionVectorsReadable (in the given Snapshot) and there are deletionVectors in the allFiles in the given Snapshot.

isTableDVFree is used when:

• Protocol is requested to assertTablePropertyConstraintsSatisfied (with compatibility.symlinkFormatManifest.enabled enabled)
• GenerateSymlinkManifestImpl is requested to generateFullManifest