SparkConf¶
SparkConf
is a Python class.
Creating Instance¶
SparkConf
takes the following to be created:
-
loadDefaults
flag (default:True
) -
JVMView
(py4j) - JConf (default:
None
)
While being created, SparkConf
uses the JVMView (of the SparkContext) unless the _jconf
and _jvm
are given.
Demo¶
from pyspark import SparkConf