Skip to content

Connector Partitioning

Partitioning is an abstraction of output data partitioning requirements (data distribution) of a Spark SQL Connector.


This Partitioning interface for Spark SQL developers mimics the internal Catalyst Partitioning that is converted into with the help of DataSourcePartitioning.


Number of Partitions

int numPartitions()

Used when:

Satisfying Distribution

boolean satisfy(
  Distribution distribution)

Used when: