DeltaTableOperations — Delta DML Operations¶
DeltaTableOperations is assumed to be associated with a DeltaTable.
Executing DeleteFromTable Command¶
executeDelete( condition: Option[Expression]): Unit
executeDelete creates a
DataFrame for a
DeleteFromTable logical operator (from Spark SQL) with (the analyzed logical plan of the DeltaTable and the given
DeleteFromTable is a
Command (Spark SQL) that represents
DELETE FROM SQL statement for v2 tables. As a
Command it is executed eagerly.
executeDelete is used for DeltaTable.delete operator.
Executing DeltaGenerateCommand Command¶
executeGenerate( tblIdentifier: String, mode: String): Unit
executeGenerate requests the SQL parser (of the
SparkSession) to parse the given table identifier, creates a DeltaGenerateCommand and runs it.
executeGenerate is used for DeltaTable.generate operator.
Executing History Command¶
executeHistory( deltaLog: DeltaLog, limit: Option[Int]): DataFrame
executeHistory is used for DeltaTable.history operator.
Executing UpdateTable Command¶
executeUpdate( set: Map[String, Column], condition: Option[Column]): Unit
UPDATE TABLE SQL statement for v2 tables and is executed eagerly.
executeVacuum( deltaLog: DeltaLog, retentionHours: Option[Double]): DataFrame
executeVacuum uses the
VacuumCommand utility to gc (with the
dryRun flag off and the given
In the end,
executeVacuum returns an empty
DataFrame (not the one from VacuumCommand.gc).
executeVacuum is used for DeltaTable.vacuum operator.