File-Based Data Scanning¶

Spark SQL uses FileScanRDD for table scans of File-Based Data Sources (e.g., parquet).

The number of partitions in data scanning is based on the following:

• maxSplitBytes hint
• Whether FileFormat is splitable or not
• Number of split files
• Bucket Pruning

File-Based Data Scanning can be bucketed or not.