PartitionFiltering¶

PartitionFiltering is an abstraction of snapshots with partition filtering for scan.

Implementations¶

Snapshot is the default and only known PartitionFiltering in Delta Lake.

Files to Scan (Matching Projection Attributes and Predicates)¶

filesForScan(
  projection: Seq[Attribute],
  filters: Seq[Expression],
  keepStats: Boolean = false): DeltaScan

filesForScan...FIXME

filesForScan is used when:

• OptimisticTransactionImpl is requested for the files to scan matching given predicates
• TahoeLogFileIndex is requested for the files matching predicates and the input files