StreamingDeduplicateExec Physical Operator¶

StreamingDeduplicateExec is a unary physical operator (Spark SQL) that writes state to StateStore with support for streaming watermark.

Short Name¶

shortName: String

shortName is part of the StateStoreWriter abstraction.

shortName is the following text:

dedupe

Required Child Output Distribution¶

requiredChildDistribution: Seq[Distribution]

requiredChildDistribution is part of the SparkPlan (Spark SQL) abstraction.

requiredChildDistribution...FIXME