Skip to content

LogStoreProvider

LogStoreProvider is an abstraction of providers of LogStores.

spark.delta.logStore.class

LogStoreProvider uses the spark.delta.logStore.class configuration property for the LogStore to create (for a DeltaLog, a DeltaHistoryManager, and DeltaFileOperations).

Creating LogStore

createLogStore(
  spark: SparkSession): LogStore
createLogStore(
  sparkConf: SparkConf,
  hadoopConf: Configuration): LogStore

createLogStore creates a LogStore based on spark.delta.logStore.class configuration property (if defined) or defaults to DelegatingLogStore.

createLogStore is used when: