Search

Google Cloud Storage

Version 25.3.9414

Google Cloud Storage

CData Sync アプリケーションからGoogle Cloud Storage コネクタを使用して、Google Cloud Storage からデータを取得してサポートされている任意の同期先に移動できます。これを行うには、コネクタを追加し、コネクタへの認証を行い、接続を完了する必要があります。

Supported File Formats

When Sync writes data to Google Cloud Storage, you can choose the file format for the exported data. The following file formats are supported for the Google Cloud Storage destination:

  • (Default) CSV—Plain text comma-separated values.

  • Avro—A row-based binary format that supports schema evolution.

  • Parquet—A columnar storage format that is optimized for analytics.

Prerequisites

If you want to authenticate with a Google Cloud service account (for silent authentication or delegated organization-wide access), do the following before configuring your connection in Sync:

  • Create a service account in Google Cloud and grant it the required permissions on your bucket or project.

  • For OAuth JWT authentication, register a custom OAuth application and download the certificate file (.p12 or .pfx).

Then proceed to the relevant authentication method below.

Google Cloud Storage コネクタを追加

Sync でGoogle Cloud Storage のデータを使用できるようにするには、まず以下の手順でコネクタを追加する必要があります。

  1. Sync のダッシュボードから接続ページを開きます。

  2. 接続を追加をクリックしてコネクタを選択ページを開きます。

  3. データソースタブをクリックしてGoogle Cloud Storage 行に移動します。

  4. 行末にある接続を設定アイコンをクリックして、新しい接続ページを開きます。接続を設定アイコンが利用できない場合は、コネクタをダウンロードアイコンをクリックしてGoogle Cloud Storage コネクタをインストールします。新規コネクタのインストールについて詳しくは、接続を参照してください。

Google Cloud Storage への認証

コネクタを追加したら、必須プロパティを設定する必要があります。

  • Connection Name: Enter a connection name of your choice.

  • File Format: Select the file format that you want to use: Delta Parquet, CSV (default), Avro, and Parquet.

    Note: The Delta Parquet file format is not supported for Sync source connectors.

  • URI: Enter the path to the resource location for your file format.

  • Project Id: Enter the identifier (Id) of the project where your Google Cloud Storage instance resides.

CData Sync supports authenticating to Google Cloud Storage in several ways. Select your authentication method below to proceed to the relevant section that contains the authentication details.

OAuth

To connect with OAuth custom credentials, specify the following properties:

  • Auth Scheme: Select OAuth.

  • OAuth Version: Select the version of OAuth that you want to use. The default version is 2.0.

  • (Optional) Scope: Specify the scope of your access to the application.

  • (Optional) OAuth Authorization URL: Enter the OAuth authorization URL for the OAuth service.

  • (Optional) OAuth Access Token URL: Enter the URL from which to retrieve the access token.

  • (Optional) OAuth Refresh Token URL: Enter the URL from which to refresh the OAuth token.

OAuth PKCE

To connect with the OAuth PKCE extension, specify the following properties:

  • Auth Scheme: Select OAuthPKCE.

  • (Optional) OAuth Client Id: Enter the client identifier (Id) that you were assigned when you registered your application with an OAuth authorization server.

OAuth JWT

To connect with a Google Cloud Storage account, specify the following properties:

  • Auth Scheme: Select OAuthJWT.

  • OAuth JWT Cert: Enter your Java web tokens (JWT) certificate store.

  • OAuth JWT Cert Type: Enter the type of key store that contains your JWT certificate. The default type is PEMKEY_BLOB.

  • OAuth Client Id: Enter the client identifier (Id) that you were assigned when you registered your application with an OAuth authorization server.

  • OAuth Client Secret: Enter the client secret that you were assigned when you registered your application with an OAuth authorization server.

  • (Optional) Scope: Specify the scope of your access to the application.

  • (Optional) OAuth Authorization URL: Enter the OAuth authorization URL for the OAuth service.

  • (Optional) OAuth Access Token URL: Enter the URL from which to retrieve the access token.

  • (Optional) OAuth Refresh Token URL: Enter the URL from which to refresh the OAuth token.

  • (Optional) OAuth JWT Cert Password: Enter the password for your OAuth JWT certificate.

  • (Optional) OAuth JWT Cert Subject: Enter the subject of your OAuth JWT certificate.

  • (Optional) OAuth JWT Subject: Enter the user subject for which the application is requesting delegated access.

  • (Optional) OAuth JWT Subject Type: Select the subject type (enterprise or user) for the JWT authentication. The default type is enterprise.

  • (Optional) OAuth JWT Public Key Id: Enter the Id of the public key for JWT.

GCP Instance Account

GCP 仮想マシンでCData Sync を実行すると、Sync は仮想マシンに紐づけられたサービスアカウントを使用して認証できます。そのアカウントを使用するには、Auth Scheme でGCPInstanceAccount を選択します。追加のプロパティは必要ありません。

Complete Your Connection

To complete your connection:

  1. Specify the following properties:

    For all file formats:

    • (Optional) Project Id: Enter the identifier (Id) of the project where your Google Cloud Storage instance resides.

      Note: This property is required for the Avro file format, and it is set in Authenticate to Google Cloud Storage

    For the CSV file format:

    • FMT: Enter the format that you want to use to parse all text files. The default format is CsvDelimited.

    • Aggregate Files: Specify whether you want to aggregate all the files that are located in the URI directory and that have the same schema into a single table named AggregatedFiles. The default option is False.

    • Include Column Headers: Specify whether you want to obtain column headers from the first lines of the specified files. The default option is True.

    For the Avro and Parquet file formats:

    • Data Model: Select the data model that you want to use to parse documents for your format and to generate the database metadata. The default data model is Document.

    • Aggregate Files: Specify whether you want to aggregate all the files that are located in the URI directory and that have the same schema into a single table named AggregatedFiles. The default option is False.

  2. 高度な設定タブで接続の高度な設定を定義します。（ただし、ほとんどの場合これらの設定は必要ありません。）

  3. OAuth and OAuthPKCE で認証する場合は、Google Cloud Storage への接続 をクリックしてGoogle Cloud Storage アカウントに接続します。

  4. 作成およびテストをクリックして接続を作成します。

詳細情報

CData Sync とGoogle Cloud Storage の連携について、詳しくはGoogle Cloud Storage Connector for CData Sync を参照してください。