TorrentBroadcastFactory

TorrentBroadcastFactory is a BroadcastFactory of TorrentBroadcasts (for BitTorrent-like Broadcast Variables).

As of Spark 2.0 TorrentBroadcastFactory is is the one and only known BroadcastFactory.

Creating Instance

TorrentBroadcastFactory takes no arguments to be created.

TorrentBroadcastFactory is created for BroadcastManager.

Creating Broadcast Variable (TorrentBroadcast)

newBroadcast[T: ClassTag](
  value_ : T,
  isLocal: Boolean,
  id: Long): Broadcast[T]

newBroadcast creates a TorrentBroadcast (for the given value_ and id and ignoring the isLocal flag).

newBroadcast is part of the BroadcastFactory abstraction.

Unbroadcasting Broadcast Variable

unbroadcast(
  id: Long,
  removeFromDriver: Boolean,
  blocking: Boolean): Unit

unbroadcast is part of the BroadcastFactory abstraction.

Initializing TorrentBroadcastFactory

initialize(
  isDriver: Boolean,
  conf: SparkConf,
  securityMgr: SecurityManager): Unit

initialize does nothing.

initialize is part of the BroadcastFactory abstraction.

Stopping TorrentBroadcastFactory

stop(): Unit

stop does nothing.

stop is part of the BroadcastFactory abstraction.