Skip to content

StreamingDeduplicateExec Physical Operator

StreamingDeduplicateExec is a unary physical operator (Spark SQL) that writes state to StateStore with support for streaming watermark.

Short Name

shortName: String

shortName is part of the StateStoreWriter abstraction.

shortName is the following text:


Required Child Output Distribution

requiredChildDistribution: Seq[Distribution]

requiredChildDistribution is part of the SparkPlan (Spark SQL) abstraction.