UpdateCommand is a DeltaCommand that represents DeltaUpdateTable logical command at execution.
UpdateCommand is a
RunnableCommand (Spark SQL) logical operator.
UpdateCommand takes the following to be created:
- Target Data (LogicalPlan)
- Update Expressions (Spark SQL)
- (optional) Condition Expression (Spark SQL)
UpdateCommand is created when:
- PreprocessTableUpdate logical resolution rule is executed (and resolves a DeltaUpdateTable logical command)
| ||number of files added.|
| ||number of files removed.|
| ||number of rows updated.|
| ||time taken to execute the entire operation|
| ||time taken to scan the files for matches|
| ||time taken to rewrite the matched files|
run( sparkSession: SparkSession): Seq[Row]
run is part of the
RunnableCommand (Spark SQL) abstraction.
performUpdate( sparkSession: SparkSession, deltaLog: DeltaLog, txn: OptimisticTransaction): Unit
rewriteFiles( spark: SparkSession, txn: OptimisticTransaction, rootPath: Path, inputLeafFiles: Seq[String], nameToAddFileMap: Map[String, AddFile], condition: Expression): Seq[FileAction]
buildUpdatedColumns( condition: Expression): Seq[Column]