DataSourceRegister¶
DataSourceRegister is an abstraction of data sources to be available under shortName alias (so it can be looked up by the alias not a fully-qualified class name)
Contract¶
Short Name¶
shortName(): String
Short name (alias) of the data source
Used when:
DataSourceutility is used to lookup a data source
Data Source Discovery¶
DataSourceRegister should register itself in META-INF/services/org.apache.spark.sql.sources.DataSourceRegister file for Java's ServiceLoader to discover the service.