Skip to content

StreamingDataSourceV2Relation Logical Operator

StreamingDataSourceV2Relation is a leaf logical operator that represents StreamingRelationV2 logical operator (with tables with a SupportsRead and MICRO_BATCH_READ or CONTINUOUS_READ capabilities) at execution time.

Creating Instance

StreamingDataSourceV2Relation takes the following to be created:

StreamingDataSourceV2Relation is created when:

Computing Stats

computeStats(): Statistics

For Scans with SupportsReportStatistics, computeStats requests the scan to estimateStatistics.

Tip

Learn more about Scan and SupportsReportStatistics in The Internals of Spark SQL online book.

For other types of scans, computeStats simply assumes the default size and no row count.

computeStats is part of the LeafNode abstraction.