WriteToDataSourceV2Exec Physical Operator¶
WriteToDataSourceV2Exec takes the following to be created:
- Refresh Cache Function (
() => Unit)
- Physical Query Plan (Spark SQL)
CustomMetrics (Spark SQL)
WriteToDataSourceV2Exec is created when:
DataSourceV2Strategy(Spark SQL) execution planning strategy is requested to plan a logical query plan (that is a WriteToDataSourceV2 logical operator)
Executing Physical Operator¶
run is part of the
V2CommandExec (Spark SQL) abstraction.
In the end,
run returns the rows written out.
ALL logging level for
org.apache.spark.sql.execution.datasources.v2.WriteToDataSourceV2Exec logger to see what happens inside.
Add the following line to
Refer to Logging.