ProjectExec Unary Physical Operator¶
ProjectExec takes the following to be created:
ProjectExec is created when:
- BasicOperators execution planning strategy is executed (to plan Project logical operator)
SparkPlanneris requested to pruneFilterProject
- DataSourceStrategy execution planning strategy is executed
- FileSourceStrategy execution planning strategy is executed
- DataSourceV2Strategy execution planning strategy is executed
FileFormatWriteris requested to write
Executing Physical Operator¶
doExecute is part of the SparkPlan abstraction.
mapPartitionsWithIndexInternal[U]( f: (Int, Iterator[T]) => Iterator[U], preservesPartitioning: Boolean = false)
doExecute requests the
UnsafeProjection to initialize and maps over the internal rows (of a partition) using the projection.
output is part of the QueryPlan abstraction.