FlatMapGroupsInPandas Logical Operator¶
FlatMapGroupsInPandas
is a unary logical operator (Spark SQL).
FlatMapGroupsInPandas
is planned as a FlatMapGroupsInPandasExec physical operator.
Creating Instance¶
FlatMapGroupsInPandas
takes the following to be created:
- Grouping Attributes (Spark SQL)
- Function Expression (Spark SQL)
- Output Attributes (Spark SQL)
- Child Logical Operator (Spark SQL)
FlatMapGroupsInPandas
is created when:
RelationalGroupedDataset
is requested to flatMapGroupsInPandas (with a PythonUDF)