ParquetOptions¶

ParquetOptions is a FileSourceOptions.

Creating Instance¶

ParquetOptions takes the following to be created:

• Parameters
• SQLConf

ParquetOptions is created when:

• HiveOptions is requested to getHiveWriteCompression
• ParquetFileFormat is requested to prepareWrite and buildReaderWithPartitionValues
• ParquetUtils is requested to inferSchema
• ParquetScan is requested to createReaderFactory
• ParquetWrite is requested to prepareWrite

Options¶

mergeSchema¶

Controls merging schemas from all Parquet part-files

Default: spark.sql.parquet.mergeSchema

Used when:

• ParquetUtils is requested to infer schema