FileSourceMetadataAttribute¶

cleanupFileSourceMetadataInformation¶

cleanupFileSourceMetadataInformation(
  attr: Attribute): Attribute

cleanupFileSourceMetadataInformation removeInternalMetadata.

cleanupFileSourceMetadataInformation is used when:

• FileFormatWriter is requested to write data out

removeInternalMetadata¶

removeInternalMetadata(
  attr: Attribute): Attribute

removeInternalMetadata removes the following internal entries from the metadata of the given Attribute:

• __metadata_col
• __file_source_metadata_col
• __file_source_constant_metadata_col
• __file_source_generated_metadata_col

Creating Metadata AttributeReference¶

apply(
  name: String,
  dataType: DataType,
  nullable: Boolean = false): AttributeReference

apply creates an AttributeReference with the following metadata:

apply is used when:

• FileFormat is requested to createFileMetadataCol