GraphElementRegistry¶

GraphElementRegistry is an abstraction of graph element registries.

Contract¶

register_dataset¶

register_dataset(
    self,
    dataset: Dataset,
) -> None

See:

• SparkConnectGraphElementRegistry

Used when:

• @create_streaming_table, @table, @materialized_view, @temporary_view decorators are used

register_flow¶

register_flow(
    self,
    flow: Flow,
) -> None

See:

• SparkConnectGraphElementRegistry

Used when:

• @append_flow, @table, @materialized_view, @temporary_view decorators are used

register_sql¶

register_sql(
    self,
    sql_text: str,
    file_path: Path,
) -> None

See:

• SparkConnectGraphElementRegistry

Used when:

• pyspark.pipelines.cli is requested to register_definitions

Implementations¶

• SparkConnectGraphElementRegistry