LocalRDDCheckpointData¶

LocalRDDCheckpointData is a RDDCheckpointData.

Creating Instance¶

LocalRDDCheckpointData takes the following to be created:

• RDD

LocalRDDCheckpointData is created when:

• RDD is requested to localCheckpoint

doCheckpoint¶

doCheckpoint(): CheckpointRDD[T]

doCheckpoint is part of the RDDCheckpointData abstraction.

doCheckpoint creates a LocalCheckpointRDD with the RDD. doCheckpoint triggers caching any missing partitions (by checking availability of the RDDBlockIds for the partitions in the BlockManagerMaster).

doCheckpointmakes sure that the StorageLevel of the RDD uses disk (among other persistence storages). If not, doCheckpoint throws an AssertionError:

Storage level [level] is not appropriate for local checkpointing