RatePerMicroBatchTable¶

RatePerMicroBatchTable is a Table (Spark SQL) that SupportsRead (Spark SQL).

Creating Instance¶

RatePerMicroBatchTable takes the following to be created:

• rowsPerBatch
• numPartitions
• startTimestamp
• advanceMillisPerBatch

RatePerMicroBatchTable is created when:

• RatePerMicroBatchProvider is requested for the table

schema¶

schema(): StructType

schema is part of the Table (Spark SQL) abstraction.

Creating ScanBuilder¶

newScanBuilder(
  options: CaseInsensitiveStringMap): ScanBuilder

newScanBuilder is part of the SupportsRead (Spark SQL) abstraction.

newScanBuilder creates a new Scan (Spark SQL) that creates a RatePerMicroBatchStream when requested for a MicroBatchStream (Spark SQL).