ShuffleOrigin¶

ShuffleOrigin describes where a ShuffleExchangeLike comes from (where it was created).

ShuffleOrigin is used (supported) by AQEShuffleReadRules.

ENSURE_REQUIREMENTS¶

The default ShuffleOrigin of ShuffleExchangeExec physical operator

Supported by AQEShuffleReadRules:

• CoalesceShufflePartitions
• OptimizeShuffleWithLocalRead
• OptimizeSkewedJoin

REBALANCE_PARTITIONS_BY_COL¶

Supported by AQEShuffleReadRules:

• CoalesceShufflePartitions
• OptimizeSkewInRebalancePartitions

REBALANCE_PARTITIONS_BY_NONE¶

Supported by AQEShuffleReadRules:

• CoalesceShufflePartitions
• OptimizeShuffleWithLocalRead
• OptimizeSkewInRebalancePartitions

REPARTITION_BY_COL¶

Indicates a user-specified repartition operator

Used to create a ShuffleExchangeExec physical operator when:

• BasicOperators execution planning strategy is executed to plan the following logical operators:

• RepartitionByExpression with the partition expressions defined

• WithCTEStrategy execution planning strategy is executed to plan the following logical operators:

  • CTERelationRef

Supported by AQEShuffleReadRules:

• CoalesceShufflePartitions

REPARTITION_BY_NUM¶

Indicates a user-specified repartition operator with a defined partition number

Used to create a ShuffleExchangeExec physical operator when:

• BasicOperators execution planning strategy is executed to plan the following logical operators:

  • Repartition with shuffle enabled
  • RepartitionByExpression with the number of partitions defined