ScanBuilder¶
ScanBuilder
is an abstraction of scan builders.
Contract¶
Building Scan¶
Scan build()
Builds a Scan
See:
Used when:
DataSourceV2Relation
logical operator is requested to computeStatsDescribeColumnExec
physical command is executedPushDownUtils
is requested to pruneColumns- V2ScanRelationPushDown logical optimization is executed (to buildScanWithPushedAggregate)
MicroBatchExecution
(Spark Structured Streaming) is requested for thelogicalPlan
ContinuousExecution
(Spark Structured Streaming) is requested for thelogicalPlan
Implementations¶
- FileScanBuilder
- JDBCScanBuilder
MemoryStreamScanBuilder
(Spark Structured Streaming)- SupportsPushDownAggregates
- SupportsPushDownFilters
SupportsPushDownLimit
- SupportsPushDownRequiredColumns
SupportsPushDownTableSample
SupportsPushDownTopN
- SupportsPushDownV2Filters