JoinedRowProcessor¶

JoinedRowProcessor is used to process partitions for MergeIntoCommand to write out merged data.

Creating Instance¶

JoinedRowProcessor takes the following to be created:

• targetRowHasNoMatch Expression
• sourceRowHasNoMatch Expression
• matchedConditions Expressions
• matchedOutputs (Seq[Seq[Seq[Expression]]])
• notMatchedConditions Expressions
• notMatchedOutputs (Seq[Seq[Seq[Expression]]])
• noopCopyOutput Expressions
• deleteRowOutput Expressions
• joinedAttributes Attributes
• joinedRowEncoder (ExpressionEncoder[Row])
• outputRowEncoder (ExpressionEncoder[Row])

JoinedRowProcessor is created when:

• MergeIntoCommand is requested to write out merged data

Processing Partition¶

processPartition(
  rowIterator: Iterator[Row]): Iterator[Row]

processPartition...FIXME

processPartition is used when:

• MergeIntoCommand is requested to write out merged data