Miscellaneous
This section provides a complete list of the Miscellaneous properties you can configure in the connection string for this provider.
| Property | Description |
| AllowKeyOnlyRegistryTopics | Specifies whether key-only registry topics are exposed as tables. Only has an effect when TypeDetectionScheme =SchemaRegistry. |
| AWSWorkloadIdentityConfig | Configuration properties to provide when using Workload Identity Federation via AWS. |
| AzureWorkloadIdentityConfig | Configuration properties to provide when using Workload Identity Federation via Azure. |
| CompressionType | Data compression type. Batches of data will be compressed together. |
| ConsumerProperties | Additional options used to configure Kafka consumers. |
| CreateTablePartitions | The number of partitions assigned to a topic created with CREATE TABLE. |
| CreateTableReplicationFactor | The number of replicas assigned to a topic created with CREATE TABLE. |
| EnableIdempotence | If set to true, the Apache Kafka will ensure messages are delivered in the correct order, and without duplicates. |
| ExposeQueueMetadataColumns | Specifies whether the Partition, Offset, and Timestamp columns are exposed. |
| FlattenArrays | By default, nested arrays won't show up if TypeDetectionScheme is set to SchemaRegistry. The FlattenArrays property can be used to flatten the elements of nested arrays into columns of their own. Set FlattenArrays to the number of elements you want to return from nested arrays. |
| GenerateSchemaFiles | Indicates the user preference as to when schemas should be generated and saved. |
| MaximumBatchSize | Specifies maximum batch size to gather before sending a request. |
| MaxRows | Specifies the maximum number of rows returned for queries that do not include either aggregation or GROUP BY. |
| MessageKeyColumn | The name of the column that message key data is stored in. |
| MessageKeyType | The type of data stored in message keys. |
| OffsetResetStrategy | Specifies an offset for the consumer group. |
| Other | Specifies additional hidden properties for specific use cases., to be used only when our Support team advises it, to address specific issues. See Remarks for details. |
| Pagesize | The maximum number of rows to fetch from Kafka at one time. |
| ProducerProperties | Additional options used to configure Kafka producers. |
| ReadDuration | The duration which additional messages are allowed. |
| Readonly | Toggles read-only access to Apache Kafka from the provider. |
| RowScanDepth | The maximum number of messages to scan for the columns available in the topic. |
| SchemaRegistryOnly | Whether to connect only to the schema registry. |
| SerializationFormat | Specifies how to serialize/deserialize message contents. |
| Timeout | Specifies the maximum time, in seconds, that the provider waits for a server response before throwing a timeout error. |
| TypeDetectionScheme | Comma-separated list of options specifying how the provider scans the data to determine the fields and datatypes for the topic. |
| UseConfluentAvroFormat | Specifies how Avro data should be formatted during an INSERT. |
| UserDefinedViews | Specifies a filepath to a JSON configuration file that defines custom views. The provider automatically detects and uses the views specified in this file. |
| ValidateRegistryTopics | Specifies whether or not to validate schema registry topics against the Apache Kafka broker. Only has an effect when TypeDetectionScheme =SchemaRegistry. |
| WorkloadPoolId | The ID of your Workload Identity Federation pool. |
| WorkloadProjectId | The ID of the Google Cloud project that hosts your Workload Identity Federation pool. |
| WorkloadProviderId | The ID of your Workload Identity Federation pool provider. |