DynamicPartitionDataSingleWriter¶
DynamicPartitionDataSingleWriter
is a BaseDynamicPartitionDataWriter.
Creating Instance¶
DynamicPartitionDataSingleWriter
takes the following to be created:
-
WriteJobDescription
-
TaskAttemptContext
(Apache Hadoop) -
FileCommitProtocol
(Spark Core) - SQLMetrics
DynamicPartitionDataSingleWriter
is created when:
FileFormatWriter
is requested to write data out in a single Spark taskFileWriterFactory
is requested to create a DataWriter