Skip to content

UnresolvedFunction

UnresolvedFunction is an Expression that represents a function (application) in a logical query plan.

UnresolvedFunction is <> as a result of the following:

[[resolved]] UnresolvedFunction can never be Expression.md#resolved[resolved] (and is replaced at analysis phase).

NOTE: UnresolvedFunction is first looked up in LookupFunctions logical rule and then resolved in ResolveFunctions logical resolution rule.

[[Unevaluable]][[eval]][[doGenCode]] Given UnresolvedFunction can never be resolved it should not come as a surprise that it cannot be evaluated either (i.e. produce a value given an internal row). When requested to evaluate, UnresolvedFunction simply reports a UnsupportedOperationException.

Cannot evaluate expression: [this]

TIP: Use Catalyst DSL's function or distinctFunction to create a UnresolvedFunction with <> flag off and on, respectively.

=== [[apply]] Creating UnresolvedFunction (With Database Undefined) -- apply Factory Method

[source, scala]

apply(name: String, children: Seq[Expression], isDistinct: Boolean): UnresolvedFunction

apply creates a FunctionIdentifier with the name and no database first and then creates a <> with the FunctionIdentifier, children and isDistinct flag.

apply is used when:

Creating Instance

UnresolvedFunction takes the following to be created:

  • [[name]] FunctionIdentifier
  • [[children]] Child Expression.md[expressions]
  • [[isDistinct]] isDistinct flag

Demo

// Using Catalyst DSL to create UnresolvedFunctions
import org.apache.spark.sql.catalyst.dsl.expressions._

// Scala Symbols supported only
val f = 'f.function()
scala> :type f
org.apache.spark.sql.catalyst.analysis.UnresolvedFunction

scala> f.isDistinct
res0: Boolean = false

val g = 'g.distinctFunction()
scala> g.isDistinct
res1: Boolean = true