StateStoreConf¶

minDeltasForSnapshot¶

spark.sql.streaming.stateStore.minDeltasForSnapshot

maxVersionsToRetainInMemory¶

spark.sql.streaming.maxBatchesToRetainInMemory

minVersionsToRetain¶

spark.sql.streaming.minBatchesToRetain

Used when HDFSBackedStateStoreProvider is requested for cleanup.

providerClass¶

spark.sql.streaming.stateStore.providerClass

Used when StateStoreProvider helper object is requested to create and initialize the StateStoreProvider.