Skip to content

Repartition Logical Operator

Repartition is a concrete RepartitionOperation.

Creating Instance

Repartition takes the following to be created:

Repartition is created for the following:

Query Planning

Repartition is planned to the following physical operators based on shuffle flag:

Catalyst DSL

Catalyst DSL defines the following operators to create a Repartition logical operator:


partitioning: Partitioning

partitioning uses the numPartitions to determine the Partitioning:

partitioning requires that the shuffle flag is enabled or throws an exception:

Partitioning can only be used in shuffle.

partitioning is part of the RepartitionOperation abstraction.