SparkConnectClient¶

Creating Instance¶

SparkConnectClient takes the following to be created:

• Configuration
• ManagedChannel (gRPC)

SparkConnectClient is created when:

• Configuration is requested for a SparkConnectClient

CustomSparkConnectBlockingStub¶

SparkConnectClient creates a new CustomSparkConnectBlockingStub when created with the following:

This CustomSparkConnectBlockingStub is used for the following:

• Analyze a plan
• Config
• Execute a plan
• Interrupt All
• Interrupt Operation
• Interrupt by Tag
• Release Session
• Create this ArtifactManager

Clone Itself¶

copy(): SparkConnectClient

copy requests this Configuration for a SparkConnectClient

copy is used when:

• SparkSession (Spark SQL) is requested for a new SparkSession

Release Session¶

releaseSession(): proto.ReleaseSessionResponse

releaseSession builds a new ReleaseSessionRequest with the following:

• This UserContext
• This sessionId
• This userAgent

In the end, releaseSession requests this CustomSparkConnectBlockingStub to releaseSession with the ReleaseSessionRequest.

releaseSession is used when:

• SparkSession is requested to close

Execute Plan¶

execute(
  plan: proto.Plan): CloseableIterator[proto.ExecutePlanResponse]

execute...FIXME