LogicalQueryStage Leaf Logical Operator¶
LogicalQueryStage takes the following to be created:
LogicalQueryStage is created when:
- AdaptiveSparkPlanExec physical operator is executed
LogicalQueryStage is a "target" of the following logical optimizations:
LogicalQueryStage is planned by LogicalQueryStageStrategy execution planning strategy.
Computing Runtime Statistics¶
computeStats is part of the LeafNode abstraction.
computeStats prints out the following DEBUG messages to the logs based on the availability of the statistics.
Physical stats available as [physicalStats] for plan: [physicalPlan]
Physical stats not available for plan: [physicalPlan]
ALL logging level for
org.apache.spark.sql.execution.adaptive.LogicalQueryStage logger to see what happens inside.
Add the following line to
logger.LogicalQueryStage.name = org.apache.spark.sql.execution.adaptive.LogicalQueryStage logger.LogicalQueryStage.level = all
Refer to Logging.