FlatMapGroupsInPandas Logical Operator¶
FlatMapGroupsInPandas is a unary logical operator (Spark SQL).
FlatMapGroupsInPandas is planned as a FlatMapGroupsInPandasExec physical operator.
Creating Instance¶
FlatMapGroupsInPandas takes the following to be created:
- Grouping Attributes (Spark SQL)
- Function Expression (Spark SQL)
- Output Attributes (Spark SQL)
- Child Logical Operator (Spark SQL)
FlatMapGroupsInPandas is created when:
RelationalGroupedDatasetis requested to flatMapGroupsInPandas (with a PythonUDF)