BasicOperators Execution Planning Strategy¶
BasicOperators is an execution planning strategy for basic conversions of logical operators to their physical counterparts.
Conversions¶
| Logical Operator | Physical Operator |
|---|---|
| CollectMetrics | CollectMetricsExec |
| DataWritingCommand | DataWritingCommandExec |
| DeserializeToObject | DeserializeToObjectExec |
| Expand | ExpandExec |
| ExternalRDD | ExternalRDDScanExec |
| FlatMapGroupsWithState | CoGroupExec or MapGroupsExec |
| ... | ... |
| Generate | GenerateExec |
| LogicalRDD | RDDScanExec |
| MemoryPlan (Spark Structured Streaming) | LocalTableScanExec |
Range | RangeExec |
| RebalancePartitions | ShuffleExchangeExec |
| Repartition | CoalesceExec or ShuffleExchangeExec based on shuffle flag |
| RepartitionByExpression | ShuffleExchangeExec |
| RunnableCommand | ExecutedCommandExec |
| WriteFiles | WriteFilesExec |
Tip
Refer to the source code of BasicOperators to confirm the most up-to-date operator mapping.