ArrowEvalPython Logical Operator¶
ArrowEvalPython is a BaseEvalPython unary logical operator that evaluates scalar PythonUDFs with Apache Arrow.
ArrowEvalPython is planned as ArrowEvalPythonExec physical operator.
ArrowEvalPython takes the following to be created:
- Scalar PythonUDFs
Attributes (Spark SQL)
- Eval Type
ArrowEvalPython is created when:
ExtractPythonUDFslogical optimization is executed (and requested to extract scalar PythonUDFs from a logical query plan)
ArrowEvalPython is given an
evalType when created that can only be one of the following: