Apache Kafka

Version 23.4.8843


Apache Kafka


CData Sync アプリケーションからApache Kafka コネクタを使用して、Apache Kafka からデータを取得してサポートされている任意の同期先に移動できます。これを行うには、コネクタを追加し、コネクタへの認証を行い、接続を完了する必要があります。

接続の確立

Sync でApache Kafka のデータを使用するには、はじめにApache Kafka への接続を確立する必要があります。以下の手順で、Apache Kafka をSync アカウントに接続します。

  1. Sync のダッシュボードから接続 ページを開きます。

  2. 接続を追加をクリックしてコネクタを選択ページを開きます。

  3. データソースタブをクリックしてApache Kafka 行に移動します。

  4. 行末にある接続を設定アイコンをクリックします。接続を設定アイコンが見当たらない場合は、接続の説明に従ってコネクタを追加する必要があります。

  5. 設定タブで接続の設定を入力します。

    • Connection Name - Enter a connection name of your choice.

    • Bootstrap Servers - Enter the address of the Apache Kafka bootstrap servers to which you want to connect.

    • Auth Scheme - Select your authentication scheme below to proceed to the relevant section for your scheme. Then fill out the settings as specified in that section.

    • Type Detection Scheme - Select a detection-scheme type to specify how Sync scans data to determine the fields and data types for the bucket.

      • None - Returns all columns as string type.

      • RowScan - Scans rows in order to determine the data type heuristically.

      • SchemaRegistry - Determines the Schema Registry API and uses a list of predefined AVRO schemas. For this scheme type, specify the following properties:

        • Registry Url - Enter the URL to the server for the schema registry. When you specify this property, Sync reads the Apache Avro schema from the server.

        • Registry Service - Select the Schema Registry service that you want to use for working with topic schemas.

          • Confluent

          • AWSGlue

        • Registry Auth Scheme - Select the scheme that you want to use to authenticate to the schema registry.

          • Auto - This scheme enables Sync to choose the scheme automatically based on the other connection properties that you set.

          • None - This scheme specifies that no authentication will be used.

          • Basic - When you select this scheme, you must specify values for Registry User and Registry Password.

            • Registry User - Enter the username that you use to authenticate to the server that is specified in the registry URL.

            • Registry Password - Enter the password that you use to authenticate to the server that is specified in the registry URL.

          • SSLCertificate - This scheme specifies that SSL client-certificate authentication should be used.

        • Registry Type (optional) - Select a registry type for the specific topic:

          • Auto (When you select Auto, Sync attempts to detect the valid schema registry type for the selected topic.)

          • JSON

          • AVRO

      • MessageOnly - Pushes all information as a single aggregate value on a column named Message.

    • Use SSL (optional) - Specify whether you want to use the Secure Sockets Layer (SSL) protocol. The default value is False.

  6. 作成およびテストをクリックして接続を作成します。

  7. 高度な設定タブで接続の高度な設定を定義します。(ただし、ほとんどの場合これらの設定は必要ありません。)

Plain

  1. For the Plain scheme, specify these settings:

    • User - Enter the username that you use to authenticate to your Kafka account.

    • Password - Enter the password that you use to authenticate to your Kafka account.

  2. Complete the remaining steps.

SCRAM

  1. For the SCRAM scheme, specify these settings:

    • User - Enter the username that you use to authenticate to your Kafka account.

    • Password - Enter the password that you use to authenticate to your Kafka account.

  2. Complete the remaining steps.

SCRAM-SHA-512

  1. For the SCRAM-SHA-512 scheme, specify these settings:

    • User - Enter the username that you use to authenticate to your Kafka account.

    • Password - Enter the password that you use to authenticate to your Kafka account.

  2. Complete the remaining steps.

Kerberos

  1. For the Kerberos scheme, specify these settings:

    • User - Enter the username that you use to authenticate to your Kafka account.

    • Password - Enter the password that you use to authenticate to your Kafka account.

    • Kerberos SPN - Enter the service principal name (SPN) for the Kerberos domain controller.

    • Kerberos Keytab File (optional) - Enter the keytab file that contains your pairs of the Kerberos principals and encrypted keys.

    • Use Kerberos Ticket Cache (optional) - Select True to use a ticket cache with the logged-in user instead of a keytab file. The default value is False.

  2. Complete the remaining steps.

SSLCertificate

  1. For the SSLCertificate scheme, specify these settings:

    • SSL Client Cert - Enter the SSL client certificate that is used to validate to the XXXXXXX broker.

    • SSL Client Cert Type - Select the format of the SSL client certificate that is used to connect to the XXXXXX broker:

      • JKSFILE

      • PFXFILE

      • PEMKEY_FILE

      • PEMKEY_BLOB

    • SSL Client Cert Password - Enter the password that is used to decrypt the SSL client certificate.

  2. Complete the remaining steps.

詳細情報

CData Sync とApache Kafka の連携について、詳しくはApache Kafka Connector for CData Sync を参照してください。