DeltaSparkSessionExtension¶
DeltaSparkSessionExtension
is used to register (inject) the following extensions to a SparkSession
:
- Delta SQL support (using DeltaSqlParser)
- DeltaAnalysis
- PreprocessTimeTravel resolution rule
- DeltaUnsupportedOperationsCheck
- PrepareDeltaScan
- PreprocessTableDelete
- PreprocessTableMerge
- PreprocessTableUpdate
- RangePartitionIdRewrite
- Table-Valued Functions
DeltaSparkSessionExtension
is registered using spark.sql.extensions
(Spark SQL) configuration property (while creating a SparkSession
in a Spark application).