Skip to content

TriggeredGraphExecution

TriggeredGraphExecution is a GraphExecution that...FIXME

Creating Instance

TriggeredGraphExecution takes the following to be created:

TriggeredGraphExecution is created when:

Topological Execution Thread

topologicalExecutionThread: Option[Thread]

topologicalExecutionThread is the Topological Execution thread of execution of this pipeline.

topologicalExecutionThread is initialized and started when TriggeredGraphExecution is requested to start.

topologicalExecutionThread runs until awaitCompletion or stopInternal.

Start Pipeline

GraphExecution
start(): Unit

start is part of the GraphExecution abstraction.

start...FIXME

buildTopologicalExecutionThread

buildTopologicalExecutionThread(): Thread

buildTopologicalExecutionThread...FIXME

topologicalExecution

topologicalExecution(): Unit

topologicalExecution...FIXME

Streaming Trigger

GraphExecution
streamTrigger(
  flow: Flow): Trigger

streamTrigger is part of the GraphExecution abstraction.

streamTrigger is AvailableNowTrigger (Spark Structured Streaming).

awaitCompletion

GraphExecution
awaitCompletion(): Unit

awaitCompletion is part of the GraphExecution abstraction.

awaitCompletion waits for this Topological Execution thread to die.

stopInternal

stopInternal(
  stopTopologicalExecutionThread: Boolean): Unit

stopInternal...FIXME


stopInternal is used when:

  • TriggeredGraphExecution is requested to start and stop

Stop Execution

GraphExecution
stop(): Unit

stop is part of the GraphExecution abstraction.

stop stopInternal (with stopTopologicalExecutionThread flag enabled).