AsyncProgressTrackingMicroBatchExecution¶

AsyncProgressTrackingMicroBatchExecution is a custom MicroBatchExecution stream execution engine for Micro-Batch Stream Processing with Async Progress Tracking enabled.

Creating Instance¶

AsyncProgressTrackingMicroBatchExecution takes the following to be created:

• SparkSession
• Trigger
• Clock
• Extra Options (Map[String, String])
• WriteToStream

AsyncProgressTrackingMicroBatchExecution is created when:

• StreamingQueryManager is requested to create a streaming query with asyncProgressTrackingEnabled flag enabled

asyncProgressTrackingEnabled¶

When enabled, asyncProgressTrackingEnabled flag indicates that StreamingQueryManager is supposed to use AsyncProgressTrackingMicroBatchExecution (not MicroBatchExecution) when requested to create a streaming query.

Default: false