Skip to content
The Internals of Delta Lake
MetadataStructField
Initializing search
delta-lake-internals
Delta Lake
Features
Internals
Developer API
Delta SQL
Commands
Demos
Misc
Monitoring
Contenders
The Internals of Delta Lake
delta-lake-internals
Delta Lake
Features
Features
Append-Only Tables
Append-Only Tables
AppendOnlyTableFeature
Auto Compaction
Auto Compaction
AutoCompact
AutoCompactBase
AutoCompactRequest
AutoCompactUtils
Change Data Feed
Change Data Feed
CDCDataSpec
CDCReader
CDCReaderImpl
CDCVersionDiffInfo
CdcAddFileIndex
ChangeDataFeedTableFeature
DeltaCDFRelation
DeltaSourceCDCSupport
IndexedChangeFileSeq
TahoeChangeFileIndex
TahoeRemoveFileIndex
CDF Table-Valued Functions
CDF Table-Valued Functions
DeltaTableValueFunction
DeltaTableValueFunctions
CHECK Constraints
CHECK Constraints
AddConstraint
AlterTableAddConstraint
AlterTableDropConstraint
DropConstraint
Checkpoints
Checkpoints
CheckpointHook
CheckpointV2
Checkpoints
Column Invariants
Column Invariants
Invariants Utility
Column Mapping
Column Mapping
DeltaColumnMappingBase (DeltaColumnMapping)
DeltaColumnMappingMode
Column Statistics
Column Statistics
Configuration Properties
Configuration Properties
DeltaSQLConf
Data Skipping
Data Skipping
ColumnPredicateBuilder
CountStarDeltaTable
DataFiltersBuilder
DataSkippingPredicateBuilder
DataSkippingReaderBase
DeltaDataSkippingType
DeltaScan
DeltaScanGenerator
FileSizeHistogram
OptimizeMetadataOnlyDeltaQuery
PrepareDeltaScan
PrepareDeltaScanBase
PreparedDeltaFileIndex
ReadsMetadataFields
ShowCountStarDeltaTable
StatsProvider
UsesMetadataFields
Deletion Vectors
Deletion Vectors
DMLWithDeletionVectorsHelper
DeletionVectorBitmapGenerator
DeletionVectorDescriptor
DeletionVectorSet
DeletionVectorStore
DeletionVectorStoreUtils
DeletionVectorStoredBitmap
DeletionVectorUtils
DeletionVectorWriter
DeletionVectorsTableFeature
HadoopFileSystemDVStore
PreprocessTableWithDVsStrategy
RowIndexFilter
RowIndexMarkingFilters
RowIndexMarkingFiltersBuilder
ScanWithDeletionVectors
StoredBitmap
TouchedFileWithDV
Developer API
Dynamic Partition Overwrite
Dynamic Partition Overwrite
DeltaDynamicPartitionOverwriteCommand
Generated Columns
Generated Columns
GeneratedColumn Utility
Installation
Liquid Clustering
Clustered Tables
Liquid Clustering
ClusterByParserUtils
ClusterByPlan
ClusterBySpec
ClusteredTableUtils
ClusteringMetadataDomain
ClusteringTableFeature
JsonMetadataDomainUtils
Log Cleanup
Log Cleanup
MetadataCleanup
LIMIT Pushdown
LIMIT Pushdown
Logging
Post-Commit Hooks
Post-Commit Hooks
GenerateSymlinkManifest
PostCommitHook
Row Tracking
Row Tracking
DefaultRowCommitVersion
DeltaScanWithRowTrackingEnabled
GenerateRowIDs
MaterializedRowCommitVersion
MaterializedRowTrackingColumn
MetadataStructField
RowCommitVersion
RowId
RowTracking
RowTrackingFeature
Spark Connector
Delta Lake on Spark SQL
Spark Connector
AdmissionLimits
DeltaDataSource
DeltaOptionParser
DeltaOptions
DeltaReadOptions
DeltaSink
DeltaSource
DeltaSourceBase
DeltaSourceMetadataEvolutionSupport
DeltaSourceMetadataTrackingLog
DeltaSourceOffset
DeltaSourceSnapshot
DeltaSourceUtils
DeltaWriteOptions
DeltaWriteOptionsImpl
Options
SchemaTrackingLog
SnapshotIterator
Storage
Storage
DelegatingLogStore
HDFSLogStore
HadoopFileSystemLogStore
LogStore
LogStoreAdaptor
LogStoreProvider
S3SingleDriverLogStore
Table Constraints
Table Constraints
Check
CheckDeltaInvariant
Constraint
Constraints
DeltaInvariantChecker
DeltaInvariantCheckerExec
DeltaInvariantCheckerStrategy
Invariant
InvariantViolationException
Table Features
Table Features
DomainMetadataTableFeature
FeatureAutomaticallyEnabledByMetadata
LegacyWriterFeature
ReaderWriterFeature
TableFeature
TableFeatureProtocolUtils
TableFeatureSupport
WriterFeature
Table Properties
Table Properties
DeltaConfig
DeltaConfigs
Time Travel
Time Travel
DeltaTimeTravelSpec
Internals
Internals
Actions
Actions
Action
AddCDCFile
AddFile
CommitInfo
DomainMetadata
FileAction
Metadata
Protocol
RemoveFile
SetTransaction
SingleAction
DelayedCommitProtocol
DeltaErrorsBase
DeltaTableIdentifier
FileFormat
FileFormat
DeltaFileFormat
DeltaParquetFileFormat
Transaction Log (DeltaLog)
Transaction Log (DeltaLog)
DeltaLog
Operation
ReadChecksum
SnapshotManagement
SnapshotDescriptor
SnapshotStateManager
VerifyChecksum
Optimistic Transactions
Optimistic Transactions
OptimisticTransaction
OptimisticTransactionImpl
TransactionalWrite
IsolationLevel
State Snapshot
State Snapshot
Snapshot
State
InitialSnapshot
InMemoryLogReplay
PartitionFiltering
LogSegment
DeltaHistoryManager
FileNames
Spark SQL Extensions
Spark SQL Extensions
AppendDelta Scala Extractor
CheckUnresolvedRelationTimeTravel
DeltaAnalysis
DeltaCatalog
DeltaSparkSessionExtension
DeltaTableV2
DeltaUnsupportedOperationsCheck
PostHocResolveUpCast
PreprocessTableDelete Logical Resolution Rule
PreprocessTableMerge Logical Resolution Rule
PreprocessTableUpdate Logical Resolution Rule
PreprocessTimeTravel
ResolveDeltaPathTable
StagedDeltaTableV2
File Indices
File Indices
SupportsRowIndexFilters
TahoeFileIndex
TahoeBatchFileIndex
TahoeFileIndexWithSnapshotDescriptor
TahoeLogFileIndex
DeltaLogFileIndex
WriteIntoDeltaBuilder
Developer API
Developer API
DeltaTable
DeltaTableBuilder
DeltaColumnBuilder
DeltaOptimizeBuilder
Exceptions
Exceptions
ConcurrentAppendException
ConcurrentDeleteDeleteException
ConcurrentDeleteReadException
ConcurrentTransactionException
ConcurrentWriteException
DeltaConcurrentModificationException
DeltaErrors Utility
MetadataChangedException
ProtocolChangedException
LogStore (io.delta.storage)
Delta SQL
Delta SQL
DeltaSqlAstBuilder
DeltaSqlParser
Commands
Commands
DeltaCommand
ALTER TABLE
ALTER TABLE
AlterDeltaTableCommand
ADD COLUMNS
ADD CONSTRAINT
CHANGE COLUMN
DROP COLUMNS
DROP CONSTRAINT
DROP FEATURE
REPLACE COLUMNS
AlterTableSetLocationDeltaCommand
SET TBLPROPERTIES
UNSET TBLPROPERTIES
RemoveColumnMappingCommand
CLONE
CLONE
CloneConvertedSource
CloneDeltaSource
CloneParquetSource
CloneSource
CloneTableBase
CloneTableBaseUtils
CloneTableCommand
CloneTableStatement
CONVERT
CONVERT
ConvertTargetTable
ConvertToDeltaCommand
ConvertToDeltaCommandUtils
DeltaConvert Utility
FileManifest
ManualListingFileManifest
MetadataLogFileManifest
ParquetTable
CREATE TABLE
CREATE TABLE
CreateDeltaTableCommand
CREATE TABLE LIKE
CREATE TABLE LIKE
DELETE
DELETE
DeleteCommand
DeleteCommandMetrics
DeltaDelete
DESCRIBE DETAIL
DESCRIBE DETAIL
DescribeDeltaDetailCommand
TableDetail
DESCRIBE HISTORY
DESCRIBE HISTORY
DeltaHistory
DescribeDeltaHistory
DescribeDeltaHistoryCommand
GENERATE
GENERATE
DeltaGenerateCommand
MERGE
MERGE
ClassicMergeExecutor
DeduplicateCDFDeletes
DeltaMergeAction
DeltaMergeBuilder
DeltaMergeInto
DeltaMergeIntoClause
WHEN Clause
DeltaMergeIntoMatchedClause
WHEN MATCHED Clause
DeltaMergeIntoMatchedDeleteClause
WHEN MATCHED DELETE Clause
DeltaMergeIntoMatchedUpdateClause
WHEN MATCHED THEN UPDATE Clause
DeltaMergeIntoNotMatchedBySourceClause
WHEN NOT MATCHED BY SOURCE Clause
DeltaMergeIntoNotMatchedBySourceDeleteClause
WHEN NOT MATCHED BY SOURCE THEN DELETE Clause
DeltaMergeIntoNotMatchedBySourceUpdateClause
WHEN NOT MATCHED BY SOURCE THEN UPDATE Clause
DeltaMergeIntoNotMatchedClause
WHEN NOT MATCHED Clause
DeltaMergeIntoNotMatchedInsertClause
WHEN NOT MATCHED THEN INSERT Clause
DeltaMergeMatchedActionBuilder
DeltaMergeNotMatchedActionBuilder
DeltaMergeNotMatchedBySourceActionBuilder
InsertOnlyMergeExecutor
JoinedRowProcessor
MergeIntoCommand
MergeIntoCommandBase
MergeIntoMaterializeSource
MergeOutputGeneration
MergeStats
OPTIMIZE
OPTIMIZE
DeltaOptimizeContext
HilbertByteArrayIndex
HilbertClustering
HilbertLongIndex
InterleaveBits
MultiDimClustering
MultiDimClusteringFunctions
OptimizeExecutor
OptimizeMetrics
OptimizeStats
OptimizeTableCommand
OptimizeTableCommandBase
PartitionerExpr
RangePartitionId
RangePartitionIdRewrite
SpaceFillingCurveClustering
ZOrderClustering
REORG
REORG
DeltaReorgTable
DeltaReorgTableCommand
RESTORE
RESTORE
RestoreTableCommand
RestoreTableCommandBase
RestoreTableStatement
TimeTravel
SHOW COLUMNS
SHOW COLUMNS
ShowDeltaTableColumnsCommand
UPDATE
UPDATE
DeltaUpdateTable
UpdateCommand
VACUUM
VACUUM
VacuumCommand
VacuumCommandImpl
VacuumTableCommand
WriteIntoDelta
Demos
Demos
Demo: Change Data Feed
Demo: Generated Columns
Demo: Column Mapping
Demo: Rolling Back Table Changes (Restore Command)
Demo: Optimize
Demo: Data Skipping
Demo: Time Travel
Demo: Vacuum
Demo: dataChange
Demo: replaceWhere
Demo: Merge Operation
Demo: Converting Parquet Dataset Into Delta Format
Demo: Stream Processing of Delta Table
Demo: Using Delta Lake as Streaming Sink in Structured Streaming
Demo: Debugging Delta Lake Using IntelliJ IDEA
Demo: Observing Transaction Retries
Demo: DeltaTable, DeltaLog And Snapshots
Demo: Schema Evolution
Demo: User Metadata for Labelling Commits
Misc
Misc
ColumnWithDefaultExprUtils
ConflictChecker
DeltaFileOperations
DeltaJobStatisticsTracker
DeltaRelation
DeltaTableOperations
DeltaTableUtils
DomainMetadataUtils
ImplicitMetadataOperation
JsonMetadataDomain
SchemaMergingUtils
SchemaUtils
StateCache
StateCache
StateCache
CachedDS — Cached Delta State
StatisticsCollection
UniversalFormat
Monitoring
Monitoring
DeltaProgressReporter
DeltaLogging
SQLMetricsReporting
Contenders
Contenders
Delta Lake
Features
Row Tracking
MetadataStructField
¶
MetadataStructField
is...FIXME
Back to top