CatalogColumnStat¶
Creating Instance¶
CatalogColumnStat takes the following to be created:
- Distinct Count (number of distinct values)
- Minimum Value
- Maximum Value
- Null Count (number of
nullvalues) - Average length of the values (for fixed-length types, this should be a constant)
- Maximum length of the values (for fixed-length types, this should be a constant)
-
Histogram - 2
Note
CatalogColumnStat uses the same input parameters as ColumnStat.
CatalogColumnStat is created when:
CatalogColumnStatis requested to fromMapColumnStatis requested to toCatalogColumnStat
fromMap¶
fromMap(
table: String,
colName: String,
map: Map[String, String]): Option[CatalogColumnStat]
fromMap creates a CatalogColumnStat using the given map (with the colName-prefixed keys).
fromMap is used when:
HiveExternalCatalogis requested to statsFromProperties
toPlanStat¶
toPlanStat(
colName: String,
dataType: DataType): ColumnStat
toPlanStat converts this CatalogColumnStat to a ColumnStat.
toPlanStat is used when:
CatalogStatisticsis requested to toPlanStats