Skip to content

Join Logical Operator

Join is a binary logical operator that represents the following high-level operators in a logical plan:

Creating Instance

Join takes the following to be created:

Join is created when:

Maximum Number of Records

LogicalPlan
maxRows: Option[Long]

maxRows is part of the LogicalPlan abstraction.

maxRows...FIXME

Catalyst DSL

DslLogicalPlan defines join operator to create a Join.

import org.apache.spark.sql.catalyst.dsl.plans._
val t1 = table("t1")
val t2 = table("t2")
val j = t1.join(t2)

import org.apache.spark.sql.catalyst.plans.logical.Join
assert(j.isInstanceOf[Join])