Skip to content

DeltaScanGenerator¶

DeltaScanGenerator is an abstraction of delta table scan generators.

Contract¶

filesForScan¶

filesForScan(
  limit: Long): DeltaScan
filesForScan(
  limit: Long,
  partitionFilters: Seq[Expression]): DeltaScan
filesForScan(
  filters: Seq[Expression],
  keepNumRecords: Boolean = false): DeltaScan

DeltaScan with the files to scan

Used when:

PrepareDeltaScanBase is requested to filesForScan

filesWithStatsForScan¶

filesWithStatsForScan(
  partitionFilters: Seq[Expression]): DataFrame

Used when:

OptimizeMetadataOnlyDeltaQuery is requested to optimizeQueryWithMetadata

Snapshot to Scan¶

snapshotToScan: Snapshot

Snapshot to generate a table scan for

Used when:

DataSkippingReaderBase is requested to filesForScan
PrepareDeltaScanBase is requested to filesForScan

Implementations¶