DeltaSparkSessionExtension¶
DeltaSparkSessionExtension is used to register (inject) Delta Lake-specific Spark SQL extensions as part of its installation.
- CheckUnresolvedRelationTimeTravel
- Delta SQL support (using DeltaSqlParser)
- DeltaAnalysis
- DeltaUnsupportedOperationsCheck
- GenerateRowIDs
- PostHocResolveUpCast
- PrepareDeltaScan
- PreprocessTableWithDVsStrategy
- PreprocessTableDelete
- PreprocessTableMerge
- PreprocessTableUpdate
- PreprocessTimeTravel resolution rule
- RangePartitionIdRewrite
- Table-Valued Functions
DeltaSparkSessionExtension is registered using spark.sql.extensions (Spark SQL) configuration property (while creating a SparkSession in a Spark application).