Skip to content

The Internals of Delta Lake

PreprocessTableWithDVsStrategy

Initializing search

delta-lake-internals

Delta Lake
Features
Internals
Developer API
Delta SQL
Commands
Demos
Misc
Monitoring
Contenders

The Internals of Delta Lake

delta-lake-internals

Delta Lake
Features
Features
- Append-Only Tables
  Append-Only Tables
  - AppendOnlyTableFeature
- Auto Compaction
  Auto Compaction
- Change Data Feed
  Change Data Feed
- CDF Table-Valued Functions
  CDF Table-Valued Functions
  - DeltaTableValueFunction
  - DeltaTableValueFunctions
- CHECK Constraints
  CHECK Constraints
- Checkpoints
  Checkpoints
- Column Invariants
  Column Invariants
  - Invariants Utility
- Column Mapping
  Column Mapping
  - DeltaColumnMappingBase (DeltaColumnMapping)
  - DeltaColumnMappingMode
- Column Statistics
  Column Statistics
- Configuration Properties
  Configuration Properties
  - DeltaSQLConf
- Data Skipping
  Data Skipping
- Deletion Vectors
  Deletion Vectors
- Developer API
- Dynamic Partition Overwrite
  Dynamic Partition Overwrite
  - DeltaDynamicPartitionOverwriteCommand
- Generated Columns
  Generated Columns
  - GeneratedColumn Utility
- Installation
- Liquid Clustering
  Clustered Tables
  Liquid Clustering
- Log Cleanup
  Log Cleanup
  - MetadataCleanup
- LIMIT Pushdown
  LIMIT Pushdown
- Logging
- Post-Commit Hooks
  Post-Commit Hooks
  - GenerateSymlinkManifest
  - PostCommitHook
- Row Tracking
  Row Tracking
- Spark Connector
  Delta Lake on Spark SQL
  Spark Connector
- Storage
  Storage
- Table Constraints
  Table Constraints
- Table Features
  Table Features
- Table Properties
  Table Properties
  - DeltaConfig
  - DeltaConfigs
- Time Travel
  Time Travel
  - DeltaTimeTravelSpec
Internals
Internals
- Actions
  Actions
  - Action
  - AddCDCFile
  - AddFile
  - CommitInfo
  - DomainMetadata
  - FileAction
  - Metadata
  - Protocol
  - RemoveFile
  - SetTransaction
  - SingleAction
- DelayedCommitProtocol
- DeltaErrorsBase
- DeltaTableIdentifier
- FileFormat
  FileFormat
  - DeltaFileFormat
  - DeltaParquetFileFormat
- Transaction Log (DeltaLog)
  Transaction Log (DeltaLog)
- Optimistic Transactions
  Optimistic Transactions
- State Snapshot
  State Snapshot
- DeltaHistoryManager
- FileNames
- Spark SQL Extensions
  Spark SQL Extensions
- File Indices
  File Indices
- WriteIntoDeltaBuilder
Developer API
Developer API
Delta SQL
Delta SQL
- DeltaSqlAstBuilder
- DeltaSqlParser
Commands
Commands
Demos
Demos
Misc
Misc
- ColumnWithDefaultExprUtils
- ConflictChecker
- DeltaFileOperations
- DeltaJobStatisticsTracker
- DeltaRelation
- DeltaTableOperations
- DeltaTableUtils
- DomainMetadataUtils
- ImplicitMetadataOperation
- JsonMetadataDomain
- SchemaMergingUtils
- SchemaUtils
- StateCache
  StateCache
  - StateCache
  - CachedDS — Cached Delta State
- StatisticsCollection
- UniversalFormat
Monitoring
Monitoring
Contenders
Contenders

Delta Lake
Features
Deletion Vectors

PreprocessTableWithDVsStrategy Execution Planning Strategy¶

PreprocessTableWithDVsStrategy is...FIXME

Copyright © 2024 Jacek Laskowski

Made with Material for MkDocs Insiders