Skip to content

VacuumCommandImpl

VacuumCommandImpl is a DeltaCommand.

Note

VacuumCommandImpl is a Scala trait just to let Databricks provide a commercial version of vacuum command.

delete

delete(
  diff: Dataset[String],
  spark: SparkSession,
  basePath: String,
  hadoopConf: Broadcast[SerializableConfiguration],
  parallel: Boolean): Long

delete...FIXME


delete is used when:

  • VacuumCommand is requested to gc

getValidRelativePathsAndSubdirs

getValidRelativePathsAndSubdirs(
  action: FileAction,
  fs: FileSystem,
  basePath: Path,
  relativizeIgnoreError: Boolean): Seq[String]

getValidRelativePathsAndSubdirs...FIXME


getValidRelativePathsAndSubdirs is used when:

getDeletionVectorRelativePath

getDeletionVectorRelativePath(
  action: FileAction): Option[Path]

getDeletionVectorRelativePath...FIXME