SchemaReadOptions — Schema Validation Flags¶

SchemaReadOptions contains the schema validation flags (based on configuration properties in a SparkSession).

SchemaReadOptions is created for the following:

• DeltaSourceBase
• SparkMicroBatchStream

allowUnsafeStreamingReadOnColumnMappingSchemaChanges¶

spark.databricks.delta.streaming.unsafeReadOnIncompatibleColumnMappingSchemaChanges.enabled

allowUnsafeStreamingReadOnPartitionColumnChanges¶

spark.databricks.delta.streaming.unsafeReadOnPartitionColumnChanges.enabled

forceEnableStreamingReadOnReadIncompatibleSchemaChangesDuringStreamStart¶

spark.databricks.delta.streaming.unsafeReadOnIncompatibleSchemaChangesDuringStreamStart.enabled

forceEnableUnsafeReadOnNullabilityChange¶

spark.databricks.delta.streaming.unsafeReadOnNullabilityChange.enabled

isStreamingFromColumnMappingTable¶

DeltaColumnMappingMode is anything but NoMapping

typeWideningEnabled¶

spark.databricks.delta.typeWidening.allowTypeChangeStreamingDeltaSource and TypeWidening.isSupported

enableSchemaTrackingForTypeWidening¶

spark.databricks.delta.typeWidening.enableStreamingSchemaTracking