OptimizeStats¶

OptimizeStats holds the statistics of OptimizeExecutor (when requested to optimize).

Creating Instance¶

OptimizeStats takes the following to be created:

• addedFilesSizeStats
• removedFilesSizeStats
• numPartitionsOptimized
• ZOrderStats
• numBatches
• totalConsideredFiles
• totalFilesSkipped
• preserveInsertionOrder
• numFilesSkippedToReduceWriteAmplification
• numBytesSkippedToReduceWriteAmplification
• startTimeMs
• endTimeMs
• totalClusterParallelism
• totalScheduledTasks
• AutoCompactParallelismStats

OptimizeStats is created when:

• OptimizeExecutor is requested to optimize

FileSizeStats¶

FileSizeStats holds the following metrics:

• minFileSize
• maxFileSize
• totalFiles
• totalSize

FileSizeStats is created and used to represent the following OptimizeStats metrics:

• addedFilesSizeStats
• removedFilesSizeStats

Creating OptimizeMetrics¶

toOptimizeMetrics: OptimizeMetrics

toOptimizeMetrics converts this OptimizeStats to a OptimizeMetrics.

toOptimizeMetrics is used when:

• OptimizeExecutor is requested to optimize