DeletionVectorWriter¶

createMapperToStoreDeletionVectors¶

createMapperToStoreDeletionVectors(
  sparkSession: SparkSession,
  hadoopConf: Configuration,
  table: Path,
  prefixLength: Int): Iterator[DeletionVectorData]

createMapperToStoreDeletionVectors creates a deletion vector partition mapper function with the callback function (callbackFn) to storeBitmapAndGenerateResult.

createMapperToStoreDeletionVectors is used when:

DeletionVectorSet is requested to build deletion vectors (and bitmapStorageMapper)

Creating Deletion Vector Partition Mapper Function¶

createDeletionVectorMapper[InputT <: Sizing, OutputT](
  sparkSession: SparkSession,
  hadoopConf: Configuration,
  table: Path,
  prefixLength: Int)
  (callbackFn: (DeletionVectorMapperContext, InputT) => OutputT): Iterator[InputT] => Iterator[OutputT]

createDeletionVectorMapper...FIXME

createDeletionVectorMapper creates a new DeletionVectorStore.

createDeletionVectorMapper...FIXME

storeBitmapAndGenerateResult¶

storeBitmapAndGenerateResult(
  ctx: DeletionVectorMapperContext,
  row: DeletionVectorData): DeletionVectorResult

storeBitmapAndGenerateResult...FIXME

storeBitmapAndGenerateResult creates a StoredBitmap to load the deletion vector.

storeBitmapAndGenerateResult...FIXME

storeSerializedBitmap¶

storeSerializedBitmap(
  ctx: DeletionVectorMapperContext,
  bitmapData: Array[Byte],
  cardinality: Long): DeletionVectorDescriptor

storeSerializedBitmap...FIXME