CachedDS — Cached Delta State¶
CachedDS takes the following to be created:
CachedDS is created when:
StateCacheis requested to cacheDS
cachedDs is a value so initialized immediately when
CachedDS is created.
cachedDs requests the Dataset for an
cachedDs associates the RDD with the name and marks it to be persist (on the first action).
cachedDs adds the RDD to the cached registry.
CachedDS is an internal class of
StateCache and has access to its internals.
cachedDs is used when:
CachedDSis requested to getDF
getDS gets the cached DataFrame and converts the rows to
getDS is used when: