RDDOperationScope¶

withScope¶

withScope[T](
  sc: SparkContext,
  name: String,
  allowNesting: Boolean,
  ignoreParent: Boolean)(
  body: => T): T
withScope[T](
  sc: SparkContext,
  allowNesting: Boolean = false)(
  body: => T): T

name Argument

Value	Caller
`checkpoint`	RDD.doCheckpoint
Some method name	Executed without `name`
The name of a physical operator (with no `Exec` suffix)	`SparkPlan.executeQuery` (Spark SQL)

withScope...FIXME

withScope is used when:

RDD is requested to doCheckpoint and withScope (for most, if not all, RDD API operators)
SparkContext is requested to withScope (for most, if not all, SparkContext API operators)
SparkPlan (Spark SQL) is requested to executeQuery