DisableUnnecessaryBucketedScan Physical Optimization¶
DisableUnnecessaryBucketedScan is a physical query plan optimization.
DisableUnnecessaryBucketedScan is a Catalyst Rule for transforming SparkPlans (
DisableUnnecessaryBucketedScan is used when:
QueryExecutionutility is used for preparations rules
AdaptiveSparkPlanExecphysical operator is requested for the physical preparation rules
DisableUnnecessaryBucketedScan takes no input arguments to be created.
apply( plan: SparkPlan): SparkPlan
apply finds FileSourceScanExec physical operators with bucketedScan enabled. If there are any, the given SparkPlan is considered to be a bucketed scan.
apply disableBucketWithInterestingPartition unless any of the configuration properties is
apply returns the given SparkPlan):
apply is part of the Rule abstraction.