Skip to content

StreamingJoinHelper Utility

StreamingJoinHelper is a Scala object with the following utility methods:

  • <>

[[logging]] [TIP] ==== Enable ALL logging level for org.apache.spark.sql.catalyst.analysis.StreamingJoinHelper to see what happens inside.

Add the following line to conf/

Refer to <>.

State Value Watermark

  attributesToFindStateWatermarkFor: AttributeSet,
  attributesWithEventWatermark: AttributeSet,
  joinCondition: Option[Expression],
  eventWatermark: Option[Long]): Option[Long]


getStateValueWatermark is used when: