BroadcastManager manages a TorrentBroadcastFactory.
BroadcastManager takes the following to be created:
While being created,
BroadcastManager is requested to initialize.
BroadcastManager is created when:
SparkEnvutility is used to create a base SparkEnv (for the driver and executors)
BroadcastManager manages a BroadcastFactory:
BroadcastManager uses the
BroadcastFactory when requested for the following:
Creating Broadcast Variable¶
newBroadcast( value_ : T, isLocal: Boolean): Broadcast[T]
newBroadcast is used when:
SparkContextis requested for a new broadcast variable
MapOutputTrackerutility is used to serializeMapStatuses
Unique Identifiers of Broadcast Variables¶
BroadcastManager tracks broadcast variables and assigns unique and continuous identifiers.
BroadcastManager is used to create a MapOutputTrackerMaster
Deleting Broadcast Variable¶
unbroadcast( id: Long, removeFromDriver: Boolean, blocking: Boolean): Unit
unbroadcast is used when:
ContextCleaneris requested to clean up a broadcast variable