DisableUnnecessaryBucketedScan Physical Optimization¶

DisableUnnecessaryBucketedScan is a physical query plan optimization.

DisableUnnecessaryBucketedScan is a Catalyst Rule for transforming SparkPlans (Rule[SparkPlan]).

DisableUnnecessaryBucketedScan is used when:

• QueryExecution utility is used for preparations rules
• AdaptiveSparkPlanExec physical operator is requested for the physical preparation rules

Creating Instance¶

DisableUnnecessaryBucketedScan takes no input arguments to be created.

Executing Rule¶

apply(
  plan: SparkPlan): SparkPlan

apply finds FileSourceScanExec physical operators with bucketedScan enabled. If there are any, the given SparkPlan is considered to be a bucketed scan.

apply disableBucketWithInterestingPartition unless any of the configuration properties is false (and apply returns the given SparkPlan):

• spark.sql.sources.bucketing.enabled
• spark.sql.sources.bucketing.autoBucketedScan.enabled

apply is part of the Rule abstraction.