Kafka Streams — Stream Processing Library on Apache Kafka¶

Kafka Streams is a library for developing applications for processing records from topics in Apache Kafka.

Kafka Streams comes with high-level Streams DSL and low-level Processor API to describe a Topology that eventually is built as a ProcessorTopology.

The execution environment of ProcessorTopology is KafkaStreams. Once created, the KafkaStreams instance is supposed to be started to start stream processing.

On partition assignment, Kafka Streams validates that the number of active tasks is the same as the number of assigned partitions (or a TaskAssignmentException is thrown).