UserDefinedPythonFunction¶
UserDefinedPythonFunction
represents a user-defined Python function.
Creating Instance¶
UserDefinedPythonFunction
takes the following to be created:
- Name
-
PythonFunction
- DataType
- Eval Type
-
udfDeterministic
flag
UserDefinedPythonFunction
is created when:
SparkConnectPlanner
is requested tohandleRegisterPythonUDF
(to register a user-defined Python function)
Creating Column (to Execute PythonUDF)¶
apply(
exprs: Column*): Column
apply
creates a Column with the PythonUDF for the given Column expressions.
Creating PythonUDF¶
builder(
e: Seq[Expression]): Expression
builder
creates a PythonUDF expression (for the given Expressions).
builder
is used when:
UDFRegistration
is requested to register a named user-defined Python functionUserDefinedPythonFunction
is requested to create a Column