GraphRegistrationContext¶
GraphRegistrationContext
is a registry of tables, views, and flows in a dataflow graph.
Creating Instance¶
GraphRegistrationContext
takes the following to be created:
- Default Catalog
- Default Database
- Default SQL Configuration Properties
GraphRegistrationContext
is created when:
DataflowGraphRegistry
is requested to createDataflowGraph
toDataflowGraph¶
toDataflowGraph: DataflowGraph
toDataflowGraph
creates a DataflowGraph for the tables, views, and flows.
toDataflowGraph
is used when:
PipelinesHandler
(Spark Connect) is requested to startRun
Tables¶
GraphRegistrationContext
creates an empty registry of Tables when created.
A new Table is added when registerTable.
Views¶
GraphRegistrationContext
creates an empty registry of Views when created.
Flows¶
GraphRegistrationContext
creates an empty registry of UnresolvedFlows when created.
Register Table¶
registerTable(
tableDef: Table): Unit
registerTable
adds the given Table to tables registry.
registerTable
is used when:
PipelinesHandler
(Spark Connect) is requested is requested to defineDataset