Catalog Plugin API and Multi-Catalog Support¶

New in 3.0.0

Main abstractions:

• CatalogManager
• CatalogPlugin
• USE NAMESPACE SQL statement
• SHOW CURRENT NAMESPACE SQL statement

Demo¶

• Developing CatalogPlugin

Example¶

SHOW NAMESPACES;

SHOW CURRENT NAMESPACE;

CREATE NAMESPACE IF NOT EXISTS my_ns;

USE NAMESPACE my_ns;

SHOW CURRENT NAMESPACE;

References¶

Articles¶

• SPIP: Identifiers for multi-catalog support
• SPIP: Catalog API for table metadata

Videos¶

• Improving Apache Spark’s Reliability with DataSourceV2 by Ryan Blue, Netflix