Spark Structured Streaming — Streaming Datasets

Spark Structured Streaming is a new computation model introduced in Spark 2.0 for building end-to-end streaming applications termed as continuous applications.

Structured streaming offers a high-level declarative streaming API built on top of Datasets (inside Spark SQL’s engine) for continuous incremental execution of structured queries.

Find more information about Spark Structured Streaming in The Internals of Spark Structured Streaming.