Skip to content


ParquetWrite is a FileWrite of ParquetTable in Parquet Connector.

Creating Instance

ParquetWrite takes the following to be created:

  • Paths
  • Format Name
  • supportsDataType function (DataType => Boolean)
  • LogicalWriteInfo

ParquetWrite is created when:

Preparing Write Job

  sqlConf: SQLConf,
  job: Job,
  options: Map[String, String],
  dataSchema: StructType): OutputWriterFactory

prepareWrite is part of the FileWrite abstraction.

prepareWrite creates a ParquetOptions (for the given options and SQLConf).

In the end, prepareWrite prepareWrite.