Skip to content

SparkTransportConf

= SparkTransportConf

SparkTransportConf is...FIXME

== [[fromSparkConf]] Creating TransportConf

[source,scala]

fromSparkConf( _conf: SparkConf, module: String, numUsableCores: Int = 0): TransportConf


fromSparkConf...FIXME

fromSparkConf is used when...FIXME

== [[defaultNumThreads]] Calculating Default Number of Threads

[source, scala]

defaultNumThreads( numUsableCores: Int): Int


defaultNumThreads calculates the default number of threads for both the Netty client and server thread pools that is 8 maximum or numUsableCores is smaller. If numUsableCores is not specified, defaultNumThreads uses the number of processors available to the Java virtual machine.

NOTE: 8 is the maximum number of threads for Netty and is not configurable.

NOTE: defaultNumThreads uses ++https://docs.oracle.com/javase/8/docs/api/java/lang/Runtime.html#availableProcessors--++[Java's Runtime for the number of processors in JVM].


Last update: 2020-10-06