spark Configuration Properties¶

broadcast.UDFCompressionThreshold¶

spark.broadcast.UDFCompressionThreshold

The threshold at which user-defined functions (UDFs) and Python RDD commands are compressed by broadcast (in bytes)

Default: 1L * 1024 * 1024 (1MB)

Used when:

• PythonUtils is requested to getBroadcastThreshold