DynamicPartitionDataSingleWriter¶
DynamicPartitionDataSingleWriter is a BaseDynamicPartitionDataWriter.
Creating Instance¶
DynamicPartitionDataSingleWriter takes the following to be created:
-
WriteJobDescription -
TaskAttemptContext(Apache Hadoop) -
FileCommitProtocol(Spark Core) - SQLMetrics
DynamicPartitionDataSingleWriter is created when:
FileFormatWriteris requested to write data out in a single Spark taskFileWriterFactoryis requested to create a DataWriter