Skip to content

JoinedRowProcessor

JoinedRowProcessor is used to process partitions for MergeIntoCommand to write out merged data.

Creating Instance

JoinedRowProcessor takes the following to be created:

  • targetRowHasNoMatch Expression
  • sourceRowHasNoMatch Expression
  • matchedConditions Expressions
  • matchedOutputs (Seq[Seq[Seq[Expression]]])
  • notMatchedConditions Expressions
  • notMatchedOutputs (Seq[Seq[Seq[Expression]]])
  • noopCopyOutput Expressions
  • deleteRowOutput Expressions
  • joinedAttributes Attributes
  • joinedRowEncoder (ExpressionEncoder[Row])
  • outputRowEncoder (ExpressionEncoder[Row])

JoinedRowProcessor is created when:

Processing Partition

processPartition(
  rowIterator: Iterator[Row]): Iterator[Row]

processPartition...FIXME

processPartition is used when: