Skip to content

FilePartitionReaderFactory

FilePartitionReaderFactory is an extension of the PartitionReaderFactory abstraction for file-based PartitionReader factories.

Implementations

  • AvroPartitionReaderFactory
  • CSVPartitionReaderFactory
  • JsonPartitionReaderFactory
  • OrcPartitionReaderFactory
  • ParquetPartitionReaderFactory
  • TextPartitionReaderFactory

Creating PartitionReader

createReader(
  partition: InputPartition): PartitionReader[InternalRow]

createReader...FIXME

createReader is part of the PartitionReaderFactory abstraction.

Creating Columnar PartitionReader

createColumnarReader(
  partition: InputPartition): PartitionReader[ColumnarBatch]

createColumnarReader...FIXME

createColumnarReader is part of the PartitionReaderFactory abstraction.