PartitionEvaluatorFactory¶
PartitionEvaluatorFactory[T, U] is an abstraction of PartitionEvaluator factories.
PartitionEvaluatorFactory is a Serializable (Java).
Contract¶
Creating PartitionEvaluator¶
createEvaluator(): PartitionEvaluator[T, U]
Creates a PartitionEvaluator
Used when:
MapPartitionsWithEvaluatorRDDis requested to compute a partitionZippedPartitionsWithEvaluatorRDDis requested to compute a partition
Implementations¶
Note
No built-in implementations available in Spark Core (but Spark SQL).