DataFrameNaFunctions — Working With Missing Data¶

DataFrameNaFunctions is used to work with <> in a structured query (a DataFrame).

[[methods]] .DataFrameNaFunctions API [cols="1,2",options="header",width="100%"] |=== | Method | Description

| <> a|

[source, scala]¶

drop(): DataFrame drop(cols: Array[String]): DataFrame drop(minNonNulls: Int): DataFrame drop(minNonNulls: Int, cols: Array[String]): DataFrame drop(minNonNulls: Int, cols: Seq[String]): DataFrame drop(cols: Seq[String]): DataFrame drop(how: String): DataFrame drop(how: String, cols: Array[String]): DataFrame drop(how: String, cols: Seq[String]): DataFrame

| <> a|

[source, scala]¶

fill(value: Boolean): DataFrame fill(value: Boolean, cols: Array[String]): DataFrame fill(value: Boolean, cols: Seq[String]): DataFrame fill(value: Double): DataFrame fill(value: Double, cols: Array[String]): DataFrame fill(value: Double, cols: Seq[String]): DataFrame fill(value: Long): DataFrame fill(value: Long, cols: Array[String]): DataFrame fill(value: Long, cols: Seq[String]): DataFrame fill(valueMap: Map[String, Any]): DataFrame fill(value: String): DataFrame fill(value: String, cols: Array[String]): DataFrame fill(value: String, cols: Seq[String]): DataFrame

| <> a|

[source, scala]¶

replaceT: DataFrame replaceT: DataFrame

|===

[[creating-instance]] DataFrameNaFunctions is available using na untyped transformation.

[source, scala]¶

val q: DataFrame = ... q.na

=== [[convertToDouble]] convertToDouble Internal Method

[source, scala]¶

convertToDouble(v: Any): Double¶

convertToDouble...FIXME

NOTE: convertToDouble is used when...FIXME

=== [[drop]] drop Method

[source, scala]¶

drop(): DataFrame drop(cols: Array[String]): DataFrame drop(minNonNulls: Int): DataFrame drop(minNonNulls: Int, cols: Array[String]): DataFrame drop(minNonNulls: Int, cols: Seq[String]): DataFrame drop(cols: Seq[String]): DataFrame drop(how: String): DataFrame drop(how: String, cols: Array[String]): DataFrame drop(how: String, cols: Seq[String]): DataFrame

drop...FIXME

=== [[fill]] fill Method

[source, scala]¶

fill(value: Boolean): DataFrame fill(value: Boolean, cols: Array[String]): DataFrame fill(value: Boolean, cols: Seq[String]): DataFrame fill(value: Double): DataFrame fill(value: Double, cols: Array[String]): DataFrame fill(value: Double, cols: Seq[String]): DataFrame fill(value: Long): DataFrame fill(value: Long, cols: Array[String]): DataFrame fill(value: Long, cols: Seq[String]): DataFrame fill(valueMap: Map[String, Any]): DataFrame fill(value: String): DataFrame fill(value: String, cols: Array[String]): DataFrame fill(value: String, cols: Seq[String]): DataFrame

fill...FIXME

=== [[fillCol]] fillCol Internal Method

[source, scala]¶

fillColT: Column¶

fillCol...FIXME

NOTE: fillCol is used when...FIXME

=== [[fillMap]] fillMap Internal Method

[source, scala]¶

fillMap(values: Seq[(String, Any)]): DataFrame¶

fillMap...FIXME

NOTE: fillMap is used when...FIXME

=== [[fillValue]] fillValue Internal Method

[source, scala]¶

fillValueT: DataFrame¶

fillValue...FIXME

NOTE: fillValue is used when...FIXME

=== [[replace0]] replace0 Internal Method

[source, scala]¶

replace0T: DataFrame¶

replace0...FIXME

NOTE: replace0 is used when...FIXME

=== [[replace]] replace Method

[source, scala]¶

replaceT: DataFrame replaceT: DataFrame

replace...FIXME

=== [[replaceCol]] replaceCol Internal Method

[source, scala]¶

replaceCol(col: StructField, replacementMap: Map[_, _]): Column¶

replaceCol...FIXME

NOTE: replaceCol is used when...FIXME