SSIS Components for Google BigQuery

Build 24.0.9175

Connection Properties

The connection properties are the various options that can be used to establish a connection. This section provides a complete list of the options you can configure in the connection settings for this provider. Click the links for further details.

For more information on establishing a connection, see Establishing a Connection.

Authentication


PropertyDescription
AuthSchemeThe type of authentication to use when connecting to Google BigQuery.
ProjectIdThe ProjectId used to resolve unqualified tables and execute jobs.
DatasetIdThe DatasetId used to resolve unqualified tables.
BillingProjectIdThe ProjectId of the billing project for executing jobs.

BigQuery


PropertyDescription
AllowLargeResultSetsWhether or not to allow large datasets to be stored in temporary tables for large datasets.
DestinationTableThis property determines where query results are stored in Google BigQuery.
UseQueryCacheSpecifies whether to use Google BigQuery's built-in query cache.
PageSizeThe number of results to return per page from Google BigQuery.
PollingIntervalThis determines how long to wait in seconds, between checks to see if a job has completed.
AllowUpdatesWithoutKeyWhether or not to allow update without primary keys.
FilterColumnsPlease set `AllowUpdatesWithoutKey` to true before you could use this property.
UseLegacySQLSpecifies whether to use BigQuery's legacy SQL dialect for this query. By default, Standard SQL will be used.
PrivateEndpointNameWhen connecting over Private Access, this property specifies the name of the custom endpoint.

Storage API


PropertyDescription
UseStorageAPISpecifies whether to use BigQuery's Storage API for bulk data reads.
UseArrowFormatSpecifies whether to use the Arrow format with BigQuery's Storage API.
StorageThresholdThe minimum number of rows a query must return to invoke the Storage API.
StoragePageSizeSpecifies the page size to use for Storage API queries.

Uploading


PropertyDescription
InsertModeSpecifies what kind of method to use when inserting data. By default streaming INSERTs are used.
WaitForBatchResultsWhether to wait for the job to complete when using the bulk upload API. Only active when InsertMode is set to Upload.
GCSBucketSpecifies the name of a GCS bucket to upload bulk data for staging.
GCSBucketFolderSpecifies the name of the folder in GCSBucket to upload bulk data for staging.
TempTableDatasetThe prefix of the dataset that will contain temporary tables when performing bulk UPDATE or DELETE operations.

OAuth


PropertyDescription
InitiateOAuthSpecifies the process for obtaining or refreshing the OAuth access token, which maintains user access while an authenticated, authorized user is working.
OAuthClientIdSpecifies the client Id that was assigned the custom OAuth application was created. (Also known as the consumer key.) This ID registers the custom application with the OAuth authorization server.
OAuthClientSecretSpecifies the client secret that was assigned when the custom OAuth application was created. (Also known as the consumer secret ). This secret registers the custom application with the OAuth authorization server.
OAuthAccessTokenA token received after authentication to the OAuth network, granting the user access. The access token is used in place of the user's login ID and password, which stay on the server.
DelegatedServiceAccountsA space-delimited list of service account emails for delegated requests.
RequestingServiceAccountA service account email to make a delegated request.
OAuthSettingsLocationSpecifies the location of the settings file where OAuth values are saved. Storing OAuth settings in a central location avoids the need for users to enter OAuth connection properties manually each time they log in. It also enables credentials to be shared across connections or processes.
CallbackURLThe URL users return to after authenticating to Google BigQuery via OAuth.
ScopeIdentifies the Google API access that your application is requesting. Scopes are space-delimited.
OAuthVerifierSpecifies a verifier code returned from the OAuthAuthorizationURL . Used when authenticating to OAuth on a headless server, where a browser can't be launched. Requires both OAuthSettingsLocation and OAuthVerifier to be set.
OAuthRefreshTokenGets and refreshes the currently-active OAuth Access Token.
OAuthExpiresInSpecifies the duration in seconds, of an OAuth Access Token's lifetime. The token can be reissued to keep access alive as long as the user keeps working.
OAuthTokenTimestampDisplays a Unix epoch timestamp in milliseconds that shows how long ago the current Access Token was created.

JWT OAuth


PropertyDescription
OAuthJWTCertThe JWT Certificate store.
OAuthJWTCertTypeThe type of key store containing the JWT Certificate.
OAuthJWTCertPasswordThe password for the OAuth JWT certificate used to access a certificate store that requires a password. If the certificate store does not require a password, leave this property blank.
OAuthJWTCertSubjectThe subject of the OAuth JWT certificate used to locate a matching certificate in the store. Supports partial matches and the wildcard '*' to select the first certificate.
OAuthJWTIssuerThe issuer of the Java Web Token.
OAuthJWTSubjectThe user subject for which the application is requesting delegated access.

SSL


PropertyDescription
SSLServerCertSpecifies the certificate to be accepted from the server when connecting using TLS/SSL.

Firewall


PropertyDescription
FirewallTypeSpecifies the protocol the provider uses to tunnel traffic through a proxy-based firewall.
FirewallServerIdentifies the IP address, DNS name, or host name of a proxy used to traverse a firewall and relay user queries to network resources.
FirewallPortSpecifies the TCP port to be used for a proxy-based firewall.
FirewallUserIdentifies the user ID of the account authenticating to a proxy-based firewall.
FirewallPasswordSpecifies the password of the user account authenticating to a proxy-based firewall.

Proxy


PropertyDescription
ProxyAutoDetectSpecifies whether the provider checks your system proxy settings for existing proxy server configurations, rather than using a manually specified proxy server.
ProxyServerThe hostname or IP address of the proxy server that you want to route HTTP traffic through.
ProxyPortThe TCP port on your specified proxy server (set in the ProxyServer connection property) that has been reserved for routing HTTP traffic to and from the client.
ProxyAuthSchemeSpecifies the authentication method the provider uses when authenticating to the proxy server specified in the ProxyServer connection property.
ProxyUserThe username of a user account registered with the proxy server specified in the ProxyServer connection property.
ProxyPasswordThe password associated with the user specified in the ProxyUser connection property.
ProxySSLTypeThe SSL type to use when connecting to the proxy server specified in the ProxyServer connection property.
ProxyExceptionsA semicolon separated list of destination hostnames or IPs that are exempt from connecting through the proxy server set in the ProxyServer connection property.

Logging


PropertyDescription
LogfileSpecifes the file path to the log file where the provider records its activities, such as authentication, query execution, and connection details.
VerbositySpecifies the verbosity level of the log file, which controls the amount of detail logged. Supported values range from 1 to 5.
LogModulesSpecifies the core modules to include in the log file. Use a semicolon-separated list of module names. By default, all modules are logged.
MaxLogFileSizeSpecifies the maximum size of a single log file in bytes. For example, '10 MB'. When the file reaches the limit, the provider creates a new log file with the date and time appended to the name.
MaxLogFileCountSpecifies the maximum number of log files the provider retains. When the limit is reached, the oldest log file is deleted to make space for a new one.

Schema


PropertyDescription
LocationSpecifies the location of a directory containing schema files that define tables, views, and stored procedures. Depending on your service's requirements, this may be expressed as either an absolute path or a relative path.
BrowsableSchemasOptional setting that restricts the schemas reported to a subset of all available schemas. For example, BrowsableSchemas=SchemaA,SchemaB,SchemaC .
TablesOptional setting that restricts the tables reported to a subset of all available tables. For example, Tables=TableA,TableB,TableC .
ViewsOptional setting that restricts the views reported to a subset of the available tables. For example, Views=ViewA,ViewB,ViewC .
RefreshViewSchemasAllows the provider to determine up-to-date view schemas automatically.
ShowTableDescriptionsControls whether table descriptions are returned via the platform metadata APIs and sys_tables / sys_views.
PrimaryKeyIdentifiersSet this property to define primary keys.
AllowedTableTypesSpecifies what kinds of tables will be visible.
FlattenObjectsDetermines whether the provider flattens STRUCT fields into top-level columns.

Miscellaneous


PropertyDescription
StorageTimeoutHow long a Storage API connection may remain active before the provider reconnects.
EmptyArraysAsNullWhether empty arrays are represented as 'null' or as '[]'.
HidePartitionColumnsWhether partition tables will show the columns _PARTITIONDATE and _PARTITIONTIME.
AllowAggregateParametersAllows raw aggregates to be used in parameters when QueryPassthrough is enabled.
ApplicationNameAn application name in the form application/version. For example, AcmeReporting/1.0.
AuditLimitThe maximum number of rows which will be stored within an audit table.
AuditModeWhat provider actions should be recorded to audit tables.
AWSWorkloadIdentityConfigConfiguration properties to provide when using Workload Identity Federation via AWS.
BigQueryOptionsA comma separated list of Google BigQuery options.
GenerateSchemaFilesIndicates the user preference as to when schemas should be generated and saved.
MaximumBillingTierThe MaximumBillingTier is a positive integer that serves as a multiplier of the basic price per TB. For example, if you set MaximumBillingTier to 2, the maximum cost for that query will be 2x basic price per TB.
MaximumBytesBilledLimits how many bytes BigQuery will allow a job to consume before it is cancelled.
MaxRowsSpecifies the maximum rows returned for queries without aggregation or GROUP BY.
OtherSpecifies additional hidden properties for specific use cases. These are not required for typical provider functionality. Use a semicolon-separated list to define multiple properties.
PseudoColumnsSpecifies the pseudocolumns to expose as table columns. Use the format 'TableName=ColumnName;TableName=ColumnName'. The default is an empty string, which disables this property.
QueryPassthroughThis option passes the query to the Google BigQuery server as is.
ReadonlyToggles read-only access to Google BigQuery from the provider.
RTKSpecifies the runtime key for licensing the provider. If unset or invalid, the provider defaults to the standard licensing method. Use this property only in environments where the standard licensing method is unsupported or requires a runtime key.
SupportCaseSensitiveTablesBy default, the provider treats table names as case-insensitive, so if multiple tables have the same name but different casing, only one will be reported in the metadata.
TableSamplePercentThis determines what percent of a table is sampled with the TABLESAMPLE operator.
TimeoutThe value in seconds until the timeout error is thrown, canceling the operation.
UserDefinedViewsSpecifies a filepath to a JSON configuration file defining custom views. The provider automatically detects and uses the views specified in this file.
WorkloadPoolIdThe ID of your Workload Identity Federation pool.
WorkloadProjectIdThe ID of the Google Cloud project that hosts your Workload Identity Federation pool.
WorkloadProviderIdThe ID of your Workload Identity Federation pool provider.

Copyright (c) 2025 CData Software, Inc. - All rights reserved.
Build 24.0.9175