CatalogColumnStat¶
Creating Instance¶
CatalogColumnStat
takes the following to be created:
- Distinct Count (number of distinct values)
- Minimum Value
- Maximum Value
- Null Count (number of
null
values) - Average length of the values (for fixed-length types, this should be a constant)
- Maximum length of the values (for fixed-length types, this should be a constant)
-
Histogram
- 2
Note
CatalogColumnStat
uses the same input parameters as ColumnStat.
CatalogColumnStat
is created when:
CatalogColumnStat
is requested to fromMapColumnStat
is requested to toCatalogColumnStat
fromMap¶
fromMap(
table: String,
colName: String,
map: Map[String, String]): Option[CatalogColumnStat]
fromMap
creates a CatalogColumnStat using the given map
(with the colName
-prefixed keys).
fromMap
is used when:
HiveExternalCatalog
is requested to statsFromProperties
toPlanStat¶
toPlanStat(
colName: String,
dataType: DataType): ColumnStat
toPlanStat
converts this CatalogColumnStat
to a ColumnStat.
toPlanStat
is used when:
CatalogStatistics
is requested to toPlanStats