Serializer

Serializer is an abstraction of serializers that are intended to be used to serialize/de-serialize data in a single Spark application.

Available Serializers

Serializer Description

JavaSerializer

KryoSerializer

newInstance Method

newInstance(): SerializerInstance

newInstance…​FIXME

newInstance is used when…​FIXME

setDefaultClassLoader Method

setDefaultClassLoader(
  classLoader: ClassLoader): Serializer

setDefaultClassLoader…​FIXME

setDefaultClassLoader is used when…​FIXME

supportsRelocationOfSerializedObjects Property

supportsRelocationOfSerializedObjects: Boolean

supportsRelocationOfSerializedObjects should be enabled (i.e. true) only when reordering the bytes of serialized objects in serialization stream output is equivalent to having re-ordered those elements prior to serializing them.

supportsRelocationOfSerializedObjects is disabled (false) by default.

KryoSerializer uses autoReset for supportsRelocationOfSerializedObjects.
supportsRelocationOfSerializedObjects is enabled in UnsafeRowSerializer.