Skip to content
The Internals of Delta Lake
TahoeRemoveFileIndex
Initializing search
delta-lake-internals
Home
Features
Internals
Delta Connector
Developer API
Delta SQL
Commands
Demos
Misc
Monitoring
Contenders
The Internals of Delta Lake
delta-lake-internals
Home
Features
Features
Change Data Feed
Change Data Feed
CdcAddFileIndex
CDCReader
DeltaSourceCDCSupport
IndexedChangeFileSeq
TahoeRemoveFileIndex
CDF Table-Valued Functions
CDF Table-Valued Functions
DeltaTableValueFunction
DeltaTableValueFunctions
CHECK Constraints
CHECK Constraints
AddConstraint
AlterTableAddConstraint
AlterTableDropConstraint
DropConstraint
Checkpoints
Checkpoints
CheckpointHook
CheckpointV2
Checkpoints
Column Invariants
Column Invariants
Invariants
Column Mapping
Column Mapping
DeltaColumnMappingBase
DeltaColumnMappingMode
Column Statistics
Column Statistics
Configuration Properties
Configuration Properties
DeltaSQLConf
CREATE TABLE LIKE
CREATE TABLE LIKE
Data Skipping
Data Skipping
ColumnPredicateBuilder
CountStarDeltaTable
DataFiltersBuilder
DataSkippingPredicateBuilder
DataSkippingReaderBase
DeltaDataSkippingType
DeltaScan
DeltaScanGenerator
FileSizeHistogram
OptimizeMetadataOnlyDeltaQuery
PrepareDeltaScan Logical Optimization
PrepareDeltaScanBase
PreparedDeltaFileIndex
ReadsMetadataFields
ShowCountStarDeltaTable
StatsProvider
UsesMetadataFields
Developer API
Generated Columns
Generated Columns
GeneratedColumn
Installation
LIMIT Pushdown
LIMIT Pushdown
Logging
Post-Commit Hooks
Post-Commit Hooks
GenerateSymlinkManifest
PostCommitHook
Table Constraints
Table Constraints
CheckDeltaInvariant
Constraint
Constraints
DeltaInvariantChecker
DeltaInvariantCheckerExec
DeltaInvariantCheckerStrategy
Invariant
InvariantViolationException
Table Properties
Time Travel
Time Travel
DeltaTimeTravelSpec
Internals
Internals
Overview
Actions
Actions
Action
AddCDCFile
AddFile
CommitInfo
FileAction
Metadata
Protocol
RemoveFile
SetTransaction
SingleAction
DelayedCommitProtocol
DeltaConfig
DeltaConfigs
DeltaTableIdentifier
FileFormat
FileFormat
DeltaFileFormat
DeltaParquetFileFormat
Transaction Log (DeltaLog)
Transaction Log (DeltaLog)
DeltaLog
Operation
SnapshotManagement
SnapshotDescriptor
ReadChecksum
MetadataCleanup
VerifyChecksum
Optimistic Transactions
Optimistic Transactions
OptimisticTransaction
OptimisticTransactionImpl
TransactionalWrite
IsolationLevel
State Snapshot
State Snapshot
Snapshot
State
InitialSnapshot
InMemoryLogReplay
PartitionFiltering
LogSegment
DeltaHistoryManager
Storage
Storage
DelegatingLogStore
LogStore
LogStoreAdaptor
LogStoreProvider
HadoopFileSystemLogStore
HDFSLogStore
S3SingleDriverLogStore
FileNames
Spark SQL Extensions
Spark SQL Extensions
AppendDelta
DeltaAnalysis
DeltaCatalog
DeltaSparkSessionExtension
DeltaTableV2
DeltaUnsupportedOperationsCheck
PreprocessTableDelete
PreprocessTableMerge
PreprocessTableUpdate
PreprocessTimeTravel
StagedDeltaTableV2
File Indices
File Indices
TahoeFileIndex
PinnedTahoeFileIndex
TahoeBatchFileIndex
TahoeLogFileIndex
DeltaLogFileIndex
WriteIntoDeltaBuilder
Delta Connector
Delta Connector
Options
Options
Options
DeltaOptionParser
DeltaOptions
DeltaReadOptions
DeltaWriteOptions
DeltaWriteOptionsImpl
AdmissionLimits
DeltaDataSource
DeltaSink
DeltaSource
DeltaSourceBase
DeltaSourceOffset
DeltaSourceSnapshot
DeltaSourceUtils
SnapshotIterator
Developer API
Developer API
DeltaTable
DeltaTableBuilder
DeltaColumnBuilder
DeltaOptimizeBuilder
Exceptions
Exceptions
ConcurrentAppendException
ConcurrentDeleteDeleteException
ConcurrentDeleteReadException
ConcurrentTransactionException
ConcurrentWriteException
DeltaConcurrentModificationException
DeltaErrors
MetadataChangedException
ProtocolChangedException
LogStore
Delta SQL
Delta SQL
DeltaSqlParser
DeltaSqlAstBuilder
Commands
Commands
DeltaCommand
ALTER TABLE
ALTER TABLE
AlterDeltaTableCommand
ADD COLUMNS
ADD CONSTRAINT
CHANGE COLUMN
AlterTableDropColumnsDeltaCommand
DROP CONSTRAINT
AlterTableReplaceColumnsDeltaCommand
AlterTableSetLocationDeltaCommand
SET TBLPROPERTIES
AlterTableUnsetPropertiesDeltaCommand
Clone
Clone
CloneDeltaSource
CloneParquetSource
CloneSource
CloneTableBase
CloneTableStatement
Convert
Convert
ConvertTargetTable
ConvertToDeltaCommand
ConvertToDeltaCommandUtils
DeltaConvert
FileManifest
ManualListingFileManifest
MetadataLogFileManifest
ParquetTable
CreateDeltaTableCommand
Delete
Delete
DeleteCommand
DeleteCommandMetrics
DeltaDelete
Describe Detail
Describe Detail
DescribeDeltaDetailCommand
Describe History
Describe History
DescribeDeltaHistoryCommand
Generate
Generate
DeltaGenerateCommand
Merge
Merge
ClassicMergeExecutor
DeduplicateCDFDeletes
DeltaMergeAction
DeltaMergeBuilder
DeltaMergeInto
DeltaMergeIntoClause
WHEN Clause
DeltaMergeIntoMatchedClause
WHEN MATCHED Clause
DeltaMergeIntoMatchedDeleteClause
WHEN MATCHED DELETE Clause
DeltaMergeIntoMatchedUpdateClause
WHEN MATCHED THEN UPDATE Clause
DeltaMergeIntoNotMatchedBySourceClause
WHEN NOT MATCHED BY SOURCE Clause
DeltaMergeIntoNotMatchedBySourceDeleteClause
WHEN NOT MATCHED BY SOURCE THEN DELETE Clause
DeltaMergeIntoNotMatchedBySourceUpdateClause
WHEN NOT MATCHED BY SOURCE THEN UPDATE Clause
DeltaMergeIntoNotMatchedClause
WHEN NOT MATCHED Clause
DeltaMergeIntoNotMatchedInsertClause
WHEN NOT MATCHED THEN INSERT Clause
DeltaMergeMatchedActionBuilder
DeltaMergeNotMatchedActionBuilder
DeltaMergeNotMatchedBySourceActionBuilder
InsertOnlyMergeExecutor
JoinedRowProcessor
MergeIntoCommand
MergeIntoCommandBase
MergeIntoMaterializeSource
MergeOutputGeneration
MergeStats
Optimize
Optimize
InterleaveBits
MultiDimClustering
MultiDimClusteringFunctions
OptimizeExecutor
OptimizeMetrics
OptimizeStats
OptimizeTableCommand
OptimizeTableCommandBase
RangePartitionId
RangePartitionIdRewrite
PartitionerExpr
SpaceFillingCurveClustering
ZOrderClustering
Restore
Restore
RestoreTableCommand
RestoreTableCommandBase
RestoreTableStatement
TimeTravel
Update
Update
UpdateCommand
DeltaUpdateTable
Vacuum
Vacuum
VacuumCommand
VacuumCommandImpl
VacuumTableCommand
WriteIntoDelta
Demos
Demos
Change Data Feed
Generated Columns
Column Mapping
Rolling Back Table Changes (Restore Command)
Optimize
Data Skipping
Time Travel
Vacuum
dataChange
replaceWhere
Merge Operation
Converting Parquet Dataset Into Delta Format
Stream Processing of Delta Table
Using Delta Lake as Streaming Sink in Structured Streaming
Debugging Delta Lake Using IntelliJ IDEA
Observing Transaction Retries
DeltaTable, DeltaLog And Snapshots
Schema Evolution
User Metadata for Labelling Commits
Misc
Misc
ColumnWithDefaultExprUtils
ConflictChecker
DeltaFileOperations
DeltaJobStatisticsTracker
DeltaRelation
DeltaTableOperations
DeltaTableUtils
ImplicitMetadataOperation
SchemaMergingUtils
SchemaUtils
StateCache
StateCache
StateCache
CachedDS
StatisticsCollection
Monitoring
Monitoring
DeltaProgressReporter
DeltaLogging
SQLMetricsReporting
Contenders
Contenders
Home
Features
Change Data Feed
TahoeRemoveFileIndex
¶
TahoeRemoveFileIndex
is...FIXME
Back to top