Transactional Writes in File-Based Connectors¶

File-based connectors use spark.sql.sources.commitProtocolClass configuration property for the class that is responsible for transactional writes.

Logging¶

Enable the following loggers:

• FileFormatWriter
• ParquetUtils
• SQLHadoopMapReduceCommitProtocol

Learn More¶

1. Transactional Writes to Cloud Storage on Databricks