BatchWriteHelper Physical Operators¶

BatchWriteHelper is an abstraction of physical operators that build batch writes.

Contract¶

Physical Query Plan¶

query: SparkPlan

SparkPlan

Used when:

• BatchWriteHelper is requested for a WriteBuilder

Writable Table¶

table: SupportsWrite

SupportsWrite

Used when:

• BatchWriteHelper is requested for a WriteBuilder

Write Options¶

writeOptions: CaseInsensitiveStringMap

Used when:

• BatchWriteHelper is requested for a WriteBuilder

Implementations¶

• AppendDataExec
• OverwriteByExpressionExec
• OverwritePartitionsDynamicExec

Creating WriteBuilder¶

newWriteBuilder(): WriteBuilder

newWriteBuilder requests the table for a WriteBuilder (with a new LogicalWriteInfoImpl with the query schema and write options).

newWriteBuilder is used when:

• AppendDataExec, OverwriteByExpressionExec and OverwritePartitionsDynamicExec physical operators are executed