Skip to content

SparkConf

SparkConf is a Python class.

Creating Instance

SparkConf takes the following to be created:

  • loadDefaults flag (default: True)
  • JVMView (py4j)
  • JConf (default: None)

While being created, SparkConf uses the JVMView (of the SparkContext) unless the _jconf and _jvm are given.

Demo

from pyspark import SparkConf