Skip to content

SpecificParquetRecordReaderBase — Hadoop RecordReader

SpecificParquetRecordReaderBase is the base Hadoop RecordReader for parquet format readers that directly materialize to T.

NOTE:[RecordReader] reads <key, value> pairs from an Hadoop InputSplit.

[[internal-registries]] .SpecificParquetRecordReaderBase's Internal Properties (e.g. Registries, Counters and Flags) [cols="1,2",options="header",width="100%"] |=== | Name | Description

| [[sparkSchema]] sparkSchema | Spark schema

Initialized when SpecificParquetRecordReaderBase is requested to <> (from the value of org.apache.spark.sql.parquet.row.requested_schema configuration as set when ParquetFileFormat is requested to build a data reader with partition column values appended) |===

=== [[initialize]] initialize Method

[source, scala]

void initialize(InputSplit inputSplit, TaskAttemptContext taskAttemptContext)

NOTE: initialize is part of ++,%20org.apache.hadoop.mapreduce.TaskAttemptContext)++[RecordReader Contract] to initialize a RecordReader.