LogStoreProvider¶

LogStoreProvider is an abstraction of providers of LogStores.

spark.delta.logStore.class¶

LogStoreProvider uses the spark.delta.logStore.class configuration property for the LogStore to create (for a DeltaLog, a DeltaHistoryManager, and DeltaFileOperations).

Creating LogStore¶

createLogStore(
  spark: SparkSession): LogStore
createLogStore(
  sparkConf: SparkConf,
  hadoopConf: Configuration): LogStore

createLogStore creates a LogStore based on spark.delta.logStore.class configuration property (if defined) or defaults to DelegatingLogStore.

createLogStore is used when:

• DeltaLog is requested for the LogStore
• LogStore.apply utility is used