DeltaSparkSessionExtension¶
DeltaSparkSessionExtension is used to register (inject) the following extensions to a SparkSession
:
- Delta SQL support (using DeltaSqlParser)
- PreprocessTableRestore logical resolution rule
- DeltaAnalysis logical resolution rule
- DeltaUnsupportedOperationsCheck
- PreprocessTableUpdate logical resolution rule
- PreprocessTableMerge logical resolution rule
- PreprocessTableDelete logical resolution rule
- PrepareDeltaScan logical optimization rule
DeltaSparkSessionExtension
is registered using spark.sql.extensions configuration property (while creating a SparkSession
in a Spark application).