PreprocessTableUpdate Logical Resolution Rule

PreprocessTableUpdate is a post-hoc logical resolution rule (Rule[LogicalPlan]) to resolve DeltaUpdateTable logical commands in a query plan into UpdateCommands.

PreprocessTableUpdate is installed (injected) into a SparkSession using DeltaSparkSessionExtension.

Creating Instance

PreprocessTableUpdate takes a single SQLConf to be created.

PreprocessTableUpdate is created when DeltaSparkSessionExtension is requested to register Delta SQL support.

Executing Rule

  plan: LogicalPlan): LogicalPlan

apply resolves (replaces) DeltaUpdateTable logical commands (in a logical query plan) into corresponding UpdateCommands.

apply is part of the Spark SQL’s Rule abstraction.