UserDefinedPythonFunction¶

UserDefinedPythonFunction represents a user-defined Python function.

Creating Instance¶

UserDefinedPythonFunction takes the following to be created:

• Name
• PythonFunction
• DataType
• Eval Type
• udfDeterministic flag

UserDefinedPythonFunction is created when:

• SparkConnectPlanner is requested to handleRegisterPythonUDF (to register a user-defined Python function)

Creating Column (to Execute PythonUDF)¶

apply(
  exprs: Column*): Column

apply creates a Column with the PythonUDF for the given Column expressions.

Creating PythonUDF¶

builder(
  e: Seq[Expression]): Expression

builder creates a PythonUDF expression (for the given Expressions).

builder is used when:

• UDFRegistration is requested to register a named user-defined Python function
• UserDefinedPythonFunction is requested to create a Column