StreamingExecutionRelation Leaf Logical Operator¶
The main use of
StreamingExecutionRelation logical operator is to be a "placeholder" in a logical query plan that will be replaced with the real relation (with new data that has arrived since the last batch) or an empty
StreamExecution is requested to transforming logical plan to include the Sources and MicroBatchReaders with new data.
StreamExecution has started running streaming batches it initializes the streaming sources by transforming the analyzed logical plan of the streaming query so that every StreamingRelation logical operator is replaced by the corresponding
StreamingExecutionRelation takes the following to be created:
- Output Attributes (
StreamingExecutionRelation is created when: