SparkConf¶
SparkConf is a Python class.
Creating Instance¶
SparkConf takes the following to be created:
-
loadDefaultsflag (default:True) -
JVMView(py4j) - JConf (default:
None)
While being created, SparkConf uses the JVMView (of the SparkContext) unless the _jconf and _jvm are given.
Demo¶
from pyspark import SparkConf