MicroBatchWriterFactory is a
DataWriterFactory (Spark SQL).
MicroBatchWriterFactory takes the following to be created:
- Epoch ID
MicroBatchWriterFactory is created when:
MicroBatchWriteis requested to create a DataWriterFactory for batch write
createWriter( partitionId: Int, taskId: Long): DataWriter[InternalRow]
createWriter is part of the
DataWriterFactory (Spark SQL) abstraction.
createWriter requests the StreamingDataWriterFactory for a DataWriter.