ParquetWrite¶

ParquetWrite is a FileWrite of ParquetTable in Parquet Connector.

Creating Instance¶

ParquetWrite takes the following to be created:

• Paths
• Format Name
• supportsDataType function (DataType => Boolean)
• LogicalWriteInfo

ParquetWrite is created when:

• ParquetTable is requested for a WriteBuilder

Preparing Write Job¶

prepareWrite(
  sqlConf: SQLConf,
  job: Job,
  options: Map[String, String],
  dataSchema: StructType): OutputWriterFactory

prepareWrite creates a ParquetOptions (for the given options and SQLConf).

In the end, prepareWrite prepareWrite.