Skip to content

CleanupDynamicPruningFilters Logical Optimization

CleanupDynamicPruningFilters is a logical optimization for Dynamic Partition Pruning.

CleanupDynamicPruningFilters is a Rule[LogicalPlan] (a Catalyst Rule for logical operators).

CleanupDynamicPruningFilters is part of the Cleanup filters that cannot be pushed down batch of the SparkOptimizer.

Executing Rule

  plan: LogicalPlan): LogicalPlan

apply is part of the Rule abstraction.


apply is a noop (does nothing and returns the given LogicalPlan) when executed with spark.sql.optimizer.dynamicPartitionPruning.enabled configuration property disabled.

apply finds logical operators with the following tree patterns:

apply transforms the given logical plan as follows: