FileNames Utility¶

Creating Hadoop Path To Delta Commit File¶

deltaFile(
  path: Path,
  version: Long): Path

deltaFile creates a Path (Apache Hadoop) to a file in the path directory.

The format of the file is as follows:

[version with leading 0s, up to 20 digits].json

Examples:

• 00000000000000000001.json
• 00000000000000012345.json

deltaFile is used when:

• DeltaHistoryManager is requested for the history of a delta table (and getCommitInfo)
• OptimisticTransactionImpl is requested to commit large and to commit (and write a commit file)
• SnapshotManagement is requested for the LogSegment for a given version (and validateDeltaVersions)
• DESCRIBE DETAIL command is executed (and describeDeltaTable)

Creating Hadoop Path To Compacted Delta File¶

compactedDeltaFile(
  path: Path,
  fromVersion: Long,
  toVersion: Long): Path

compactedDeltaFile creates a Path (Apache Hadoop) to a file in the path directory.

The format of the file is as follows:

[fromVersion with leading 0s, up to 20 digits].[toVersion with leading 0s, up to 20 digits].compacted.json

Examples:

• 00000000000000000001.00000000000000012345.compacted.json