RemoveBOMCharacter
Specifies whether the provider should remove the Byte Order Mark (BOM) character (0xFEFF) from content.
Data Type
bool
Default Value
false
Remarks
The BOM character (0xFEFF) is sometimes present at the beginning of UTF-8 or UTF-16 encoded files or API responses to indicate byte order. However, this character can cause issues in parsing or processing content, especially in CSV imports, API responses, or when reading metadata.
When RemoveBOMCharacter is set to true, the component strips the BOM character from incoming content to ensure clean parsing and avoid errors or unexpected characters in query results and metadata discovery.
Performance Considerations
Removing BOM characters may improve compatibility when working with external data sources or APIs that include this marker. However, if the source system relies on BOM for encoding interpretation, removing it could lead to misinterpretation of character encoding in certain edge cases. This property should generally be enabled when encountering unexpected characters or parsing errors at the start of content.
This property is useful for handling clean input when dealing with file imports, streamed data, or API responses where the BOM character is present and causes parsing issues.