PythonUtils¶
Broadcast Threshold¶
getBroadcastThreshold(
sc: JavaSparkContext): Long
getBroadcastThreshold is the value of spark.broadcast.UDFCompressionThreshold configuration property.
py4j
getBroadcastThreshold is a Scala method that is used by pyspark.rdd Python module via py4j bridge.
getBroadcastThreshold is used when:
pyspark.rddis requested to _prepare_for_python_RDD