Version 23.4.8843

• Add the Google BigQuery Connector
• Authenticate to Google BigQuery
  • OAuth
  • OAuthJWT
  • GCP Instance Account
• Complete Your Connection
• More Information

You can use the Google BigQuery connector from the CData Sync application to move data from any supported source to the Google BigQuery destination. To do so, you need to add the connector, authenticate to the connector, and complete your connection.

Add the Google BigQuery Connector

To enable Sync to use data from Google BigQuery, you first must add the connector, as follows:

1. Open the Connections page of the Sync dashboard.

2. Click Add Connection to open the Select Connectors page.

3. Click the Destinations tab and locate the Google BigQuery row.

4. Click the Configure Connection icon at the end of that row to open the New Connection page. If the Configure Connection icon is not available, click the Download Connector icon to install the Google BigQuery connector. For more information about installing new connectors, see Connections.

Authenticate to Google BigQuery

After you add the connector, you need to set the required properties.

On the New Connection page, enter the connection name of your choice.

CData Sync supports authenticating to Google BigQuery in several ways. Select your authentication method below to proceed to the relevant section that contains the authentication details.

• OAuth

• OAuthJWT

• GCPInstanceAccount

OAuth

CData Sync provides an embedded OAuth application with which to connect. To use the application, select OAuth for Auth Scheme. No additional properties are required.

OAuthJWT

To connect with a Google service account, specify the following properties:

• Auth Scheme - Select OAuthJWT.

• OAuth JWT Cert – Enter your Java web tokens (JWT) certificate store.

• OAuth JWT Cert Type – Enter the type of key store that contains your JWT Certificate. The default type is GOOGLEJSONBLOB.

• OAuth JWT Subject – Enter the user subject for which the application is requesting delegated access.

GCP Instance Account

When you run CData Sync on a GCP virtual machine, CData Sync can authenticate by using the service account that is tied to the virtual machine. Select GCPInstanceAccount for Auth Scheme to use that account. No additional properties are required.

Complete Your Connection

To complete your connection:

1. Specify the following settings:

   • Project Id - Enter the identifier of the project to which Sync should connect.

   • Dataset Id (optional) - Enter the identifier of the data set to which Sync should connect.

   • Insert Mode - Select the method that you want to use to insert data. The default method is Streaming. For GCSStaging, you need to specify these settings as well:

     • GCS Bucket - Enter the name of a GCS bucket that you want to use to upload bulk data for staging.

     • GCS Bucket Folder - Enter the name of the specific folder in the GCS bucket where you want to upload bulk data for staging.

2. Define advanced connection settings on the Advanced tab. (In most cases, though, you should not need these settings.)

3. Click Connect to Google BigQuery to connect to your Google BigQuery account.

4. Click Create & Test to create your connection.

More Information

For more information about interactions between CData Sync and Google BigQuery, see Google BigQuery Connector for CData Sync.