Version 25.3.9414

• Avro コネクタを追加
• Avro への認証
  • Local
  • Amazon S3
  • Azure Blob Storage
  • Azure Data Lake Storage
  • Azure Files
  • Box
  • Dropbox
  • FTP
  • Google Cloud Storage
  • Google Drive
  • Hadoop Distributed File System (HDFS)
  • HTTP
  • IBM Object Storage Source
  • OneDrive
  • Oracle Cloud Storage
  • SFTP
  • SharePoint Online
• Complete Your Connection
• 詳細情報

CData Sync アプリケーションからAvro コネクタを使用して、Avro からデータを取得してサポートされている任意の同期先に移動できます。これを行うには、コネクタを追加し、コネクタへの認証を行い、接続を完了する必要があります。

Avro コネクタを追加

Sync でAvro のデータを使用できるようにするには、まず以下の手順でコネクタを追加する必要があります。

1. Sync のダッシュボードから接続ページを開きます。

2. 接続を追加をクリックしてコネクタを選択ページを開きます。

3. データソースタブをクリックしてAvro 行に移動します。

4. 行末にある接続を設定アイコンをクリックして、新しい接続ページを開きます。接続を設定アイコンが利用できない場合は、コネクタをダウンロードアイコンをクリックしてAvro コネクタをインストールします。新規コネクタのインストールについて詳しくは、接続を参照してください。

Avro への認証

コネクタを追加したら、必須プロパティを設定する必要があります。

On the New Connection page, enter the connection name of your choice.

CData Sync supports the ability to connect to local and cloud-hosted Avro files. Select your connection type below to proceed to the relevant section that contains the connection details.

• Local
• Amazon S3
• Azure Blob Storage
• Azure Data Lake Storage
• Azure Files
• Box
• Dropbox
• FTP
• Google Cloud Storage
• Google Drive
• HDFS
• HTTP
• IBM Object Storage Source
• OneDrive
• Oracle Cloud Storage
• SFTP
• SharePoint Online

Local

To connect to Avro resources on the local drive, specify the following settings:

• Connection Type - Select Local.

• URI - Enter your local directory path, one file per table (for example, C:/FolderPath).

This connection type does not require any authentication settings. Complete the remaining steps for establishing your connection.

Amazon S3

To connect to Avro resources on Amazon S3, use the Amazon S3 connector instead.

Azure Blob Storage

To connect to Avro resources on Azure Blob Storage, specify the following settings:

• Connection Type - Select Azure Blob Storage.

• URI - Enter the name of your container and blob in the URI text box (for example, azureblob://MyContainer/MyBlob).

• Azure Storage Account - Enter the name of your Azure storage account.

See Connecting to Azure Blob Storage for details about choosing your authentication scheme.

Azure Data Lake Storage

To connect to Avro resources on Azure Data Lake Storage, use the Azure Data Lake Storage connector instead.

Azure Files

To connect to Avro resources on Azure File Storage, specify these properties:

• Connection Type - Select Azure Files.

• URI - Enter the name of your Azure file share and the name of the resource (for example, azurefile://FileShare/RemotePath).

• Azure Storage Account - Enter the name of your Azure storage account.

See Connecting to Azure Files for details about choosing your authentication scheme.

Box

To connect to Avro resources on Box, specify these properties:

• Connection Type - Select Box.

• URI - Enter the pathname for the file system and the name of the folder that contains your CSV files (for example, box://Folder1).

• Auth Scheme - Select OAuth. CData Sync provides an embedded OAuth application with which to connect. No additional properties are required.

Complete the remaining steps for establishing your connection.

Dropbox

To connect to Avro resources on Dropbox, specify these properties:

• Connection Type - Select Dropbox.

• URI - Enter the path to a folder that contains Avro files (for example, dropbox://Folder1).

• Auth Scheme - Select OAuth. provides an embedded OAuth application with which to connect. No additional properties are required.

Complete the remaining steps for establishing your connection.

FTP

To connect to Avro resources on an FTP server, specify these properties:

• Connection Type - Select either FTP or FTPS.

• URI - Enter the address of the server, followed by the path to the folder that you want to use as the root folder, as shown in these examples:

  • FTP: ftp://localhost:990/Folder1

  • FTPS: ftps://localhost:990/Folder1

• Auth Scheme - Use the default scheme, Basic.

• User - Enter the username that you use to authenticate to your FTP or FTPS server.

• Password - Enter the password that you use to authenticate to your FTP or FTPS server.

Complete the remaining steps for establishing your connection.

Google Cloud Storage

To connect to Avro resources on Google Cloud Storage, specify these properties:

• Connection Type - Select Google Cloud Storage.

• URI - Enter the name of the bucket and folder that contains your Avro files (for example, gs://Bucket/RemotePath).

• Project Id - Enter the identifier for the project to which you want to connect.

See Connecting to Google Cloud Storage for details about choosing your authentication scheme.

Google Drive

To connect to Avro resources on Google Drive, specify these properties:

• Connection Type - Select Google Drive.

• URI - Enter the pathname for the file system and the name of the folder that contains your Avro files (for example, gdrive://Folder1).

See Connecting to Google Drive for details about choosing your authentication scheme.

Hadoop Distributed File System (HDFS)

To connect to Avro resources on HDFS, specify these properties:

• Connection Type - Select either HDFS or HDFS Secure.

• URI - Enter the path to a folder that contains your Avro files, as shown in these examples:

  • HDFS: webhdfs://Host:Port/RemotePath

  • HDFS Secure: webhdfss://Host:Port/RemotePath

See Connecting to HDFS for details about choosing your authentication scheme.

HTTP

To connect to Avro resources on HTTP Streams, specify these properties:

• Connection Type - Select either HTTP or HTTPS.

• URI - Enter the path to a folder that contains your Avro files, as shown in these examples:

  • HTTP: http://RemoteStream

  • HTTPS: https://RemoteStream

See Connecting to HTTP or HTTPS for details about setting your authentication scheme.

IBM Object Storage Source

To connect to Avro resources on IBM Object Storage, specify these properties:

• Connection Type - Select IBM Object Storage Source.

• URI - Enter the path to a folder that contains your Avro files (for example, ibmobjectstorage://Bucket1/RemotePath).

• Api Key - Enter the API key for your IBM Object Storage source. To obtain this key:

  1. Log in to your IBM Cloud account.

  2. Navigate to the Platform API Keys page.

  3. Click Create an IBM Cloud API Key (middle right corner ) to create a new API key. This action opens a dialog box.

  4. Specify a name for the API key name. Then, click Create.

  Note: Save the API key somewhere because you cannot access it again from the dashboard.

• Region - Enter the region for your IBM instance (for example, eu-gb).

See Connecting to IBM Object Storage for details about choosing your authentication scheme.

OneDrive

To connect to Avro resources on OneDrive, specify these properties:

• Connection Type - Select OneDrive.

• URI - Enter the path to a folder that contains your Avro files (for example, onedrive://RemotePath).

See Connecting to OneDrive for details about choosing your authentication scheme.

Oracle Cloud Storage

To connect to Avro resources on Oracle Cloud Storage, specify these properties:

• Connection Type - Select OracleCloudStorage.

• URI - Enter the path to a folder that contains your Avro files (for example, os://Bucket/RemotePath).

• Region - Enter the hosting region for your S3-like web services.

• Oracle Namespace - Enter your Oracle cloud namespace.

• Auth Scheme - Use the default scheme, HMAC.

• Access Key - Enter your Oracle Cloud access key.

• Secret Key - Enter your Oracle Cloud secret key.

Complete the remaining steps for establishing your connection.

SFTP

To connect to Avro resources on an SFTP server, specify these properties:

• Connection Type - Select SFTP.

• URI - Enter the path to a folder that contains your Avro files (for example, sftp://Server:Port/RemotePath).

• Auth Scheme - Use the default scheme, SFTP.

See Connecting to SFTP for details about choosing your SSH authentication mode.

SharePoint Online

To connect to Avro resources on SharePoint Online, specify these properties:

• Connection Type - Select either SharePoint Online REST or SharePoint Online SOAP.

• URI - Enter the path to a folder that contains your Avro files, as shown in these examples:

  • SharePoint Online REST: sprest://RemotePath

  • SharePoint Online SOAP: spr://RemotePath

• Storage Base URL - Enter the base URL for the SharePoint site. The following are examples of valid URLs:

  • http://server/SharePoint/

  • http://server/Sites/mysite/

  • http://server:90/

Note: If the domain for this option ends in -my (for example, https://bigcorp-my.sharepoint.com), then you might need to connect through OneDrive.

See Connecting to SharePoint Online for details about choosing your authentication scheme.

Complete Your Connection

To complete your connection:

1. Specify the following properties:

   • Data Model - Select the data model to use for parsing Avro documents and generating the database metadata. The default data model is Document.

   • OAuth Grant Type - Select the grant type for the OAuth flow. The default type is CODE.

   • Aggregate Files - Specify whether you want to aggregate all the files in the URI directory into a single result. The default version is False.

2. 高度な設定タブで接続の高度な設定を定義します。（ただし、ほとんどの場合これらの設定は必要ありません。）

3. AzureAD, OAuth, or OAuthPKCE で認証する場合は、Avro への接続 をクリックしてAvro アカウントに接続します。

4. 作成およびテストをクリックして接続を作成します。

詳細情報

CData Sync とAvro の連携について、詳しくはAvro Connector for CData Sync を参照してください。