Skip to content

DisableUnnecessaryBucketedScan Physical Optimization

DisableUnnecessaryBucketedScan is a physical query plan optimization.

DisableUnnecessaryBucketedScan is a Catalyst Rule for transforming SparkPlans (Rule[SparkPlan]).

DisableUnnecessaryBucketedScan is used when:

Creating Instance

DisableUnnecessaryBucketedScan takes no input arguments to be created.

Executing Rule

  plan: SparkPlan): SparkPlan

apply finds FileSourceScanExec physical operators with bucketedScan enabled. If there are any, the given SparkPlan is considered to be a bucketed scan.

apply disableBucketWithInterestingPartition unless any of the configuration properties is false (and apply returns the given SparkPlan):

apply is part of the Rule abstraction.