CachedDS — Cached Delta State

CachedDS (of As) is created exclusively when StateCache is requested to cacheDS.

CachedDS is an internal class of StateCache and has access to its internals.

Creating CachedDS Instance

CachedDS takes the following to be created:

  • Dataset[A]

  • Name

getDS Method

getDS: Dataset[A]

getDS…​FIXME

getDS is used when:

Internal Properties

Name Description

dsCache

(Option[Dataset[A]])

Used when…​FIXME

rddCache

(Option[RDD[InternalRow]])

Used when…​FIXME