Spark's Hello World using Spark shell and Scala

== Exercise: Spark's Hello World using Spark shell and Scala

Run Spark shell and count the number of words in a file using MapReduce pattern.

  • Use sc.textFile to read the file into memory
  • Use RDD.flatMap for a mapper step
  • Use reduceByKey for a reducer step

Last update: 2020-10-06