Miscellaneous
This section provides a complete list of the Miscellaneous properties you can configure in the connection string for this provider.
Property | Description |
AggregateMessages | Specifies whether or not to return the message as a whole string. |
BatchSize | The maximum size of each batch operation to submit. |
CompressionType | Data compression type. Batches of data will be compressed together. |
ConnectionLifeTime | The maximum lifetime of a connection in seconds. Once the time has elapsed, the connection object is disposed. |
ConnectOnOpen | This property specifies whether to connect to the Apache Kafka when the connection is opened. |
ConsumerProperties | Additional options used to configure Kafka consumers. |
CreateTablePartitions | The number of partitions assigned to a topic created with CREATE TABLE. |
CreateTableReplicationFactor | The number of replicas assigned to a topic created with CREATE TABLE. |
EnableIdempotence | If set to true, the Apache Kafka will ensure messages are delivered in the correct order, and without duplicates. |
FlattenArrays | By default, nested arrays won't show up if TypeDetectionScheme is set to SchemaRegistry. The FlattenArrays property can be used to flatten the elements of nested arrays into columns of their own. Set FlattenArrays to the number of elements you want to return from nested arrays. |
GenerateSchemaFiles | Indicates the user preference as to when schemas should be generated and saved. |
MaximumBatchSize | Specifies maximum batch size to gather before sending a request. |
MaxRows | Limits the number of rows returned rows when no aggregation or group by is used in the query. This helps avoid performance issues at design time. |
MessageKeyColumn | If specified, the message key sent to Apache Kafka will be read from this column. |
MessageKeyType | If MessageKeyColumn is specified, this property must be set to the expected type for the pertinent column. |
OffsetResetStrategy | Specifies an offset for the consumer group. |
Other | These hidden properties are used only in specific use cases. |
PoolIdleTimeout | The allowed idle time for a connection before it is closed. |
PoolMaxSize | The maximum connections in the pool. |
PoolMinSize | The minimum number of connections in the pool. |
PoolWaitTime | The max seconds to wait for an available connection. |
ProduceMeta | Specifies whether or not to send a meta message while producing the outgoing message. |
ProducerProperties | Additional options used to configure Kafka producers. |
PseudoColumns | This property indicates whether or not to include pseudo columns as columns to the table. |
ReadDuration | The duration which additional messages are allowed. |
Readonly | You can use this property to enforce read-only access to Apache Kafka from the provider. |
RowScanDepth | The maximum number of messages to scan for the columns available in the topic. |
RTK | The runtime key used for licensing. |
SerializationFormat | Specifies how to serialize/deserialize the incoming or outgoing message. |
Timeout | The value in seconds until the timeout error is thrown, canceling the operation. |
TypeDetectionScheme | Comma-separated list of options specifying how the provider will scan the data to determine the fields and datatypes for the bucket. |
UseConfluentAvroFormat | Specifies how Avro data should be formatted during an INSERT. |
UseConnectionPooling | This property enables connection pooling. |
UserDefinedViews | A filepath pointing to the JSON configuration file containing your custom views. |
ValidateRegistryTopics | Specifies whether or not to validate schema registry topics against the Apache Kafka broker. Only has an effect when TypeDetectionScheme =SchemaRegistry. |