File Data Source¶
File Data Source comes with the following main abstractions:
FileStreamSink uses FileStreamSinkLog for tracking valid files per micro-batch (as part of ManifestFileCommitProtocol).
File Data Source comes with the following main abstractions:
FileStreamSink uses FileStreamSinkLog for tracking valid files per micro-batch (as part of ManifestFileCommitProtocol).