KafkaStreamingWrite¶

KafkaStreamingWrite is a StreamingWrite.

Creating Instance¶

KafkaStreamingWrite takes the following to be created:

• Topic Name (Optional)
• Kafka Producer Parameters
• Schema

KafkaStreamingWrite is created when:

• KafkaWrite (Spark SQL) is requested for a StreamingWrite

Creating StreamingDataWriterFactory¶

createStreamingWriterFactory(
  info: PhysicalWriteInfo): KafkaStreamWriterFactory

createStreamingWriterFactory is part of the StreamingWrite abstraction.

createStreamingWriterFactory creates a KafkaStreamWriterFactory for the given topic, producerParams and schema.