Apache Kafka
Version 23.4.8843
Version 23.4.8843
Apache Kafka
CData Sync アプリケーションからApache Kafka コネクタを使用して、Apache Kafka からデータを取得してサポートされている任意の同期先に移動できます。これを行うには、コネクタを追加し、コネクタへの認証を行い、接続を完了する必要があります。
接続の確立
Sync でApache Kafka のデータを使用するには、はじめにApache Kafka への接続を確立する必要があります。以下の手順で、Apache Kafka をSync アカウントに接続します。
-
Sync のダッシュボードから接続 ページを開きます。
-
接続を追加をクリックしてコネクタを選択ページを開きます。
-
データソースタブをクリックしてApache Kafka 行に移動します。
-
行末にある接続を設定アイコンをクリックします。接続を設定アイコンが見当たらない場合は、接続の説明に従ってコネクタを追加する必要があります。
-
設定タブで接続の設定を入力します。
-
Connection Name - Enter a connection name of your choice.
-
Bootstrap Servers - Enter the address of the Apache Kafka bootstrap servers to which you want to connect.
-
Auth Scheme - Select your authentication scheme below to proceed to the relevant section for your scheme. Then fill out the settings as specified in that section.
- None (This Auth scheme does not require any additional settings. So, you can select this scheme and continue with the settings and steps below.)
- Plain
- SCRAM (for SCRAM-SHA-256)
- SCRAM-SHA-512
- Kerberos
- SSLCertificate
-
Type Detection Scheme - Select a detection-scheme type to specify how Sync scans data to determine the fields and data types for the bucket.
-
None - Returns all columns as string type.
-
RowScan - Scans rows in order to determine the data type heuristically.
-
SchemaRegistry - Determines the Schema Registry API and uses a list of predefined AVRO schemas. For this scheme type, specify the following properties:
-
Registry Url - Enter the URL to the server for the schema registry. When you specify this property, Sync reads the Apache Avro schema from the server.
-
Registry Service - Select the Schema Registry service that you want to use for working with topic schemas.
-
Confluent
-
AWSGlue
-
-
Registry Auth Scheme - Select the scheme that you want to use to authenticate to the schema registry.
-
Auto - This scheme enables Sync to choose the scheme automatically based on the other connection properties that you set.
-
None - This scheme specifies that no authentication will be used.
-
Basic - When you select this scheme, you must specify values for Registry User and Registry Password.
-
Registry User - Enter the username that you use to authenticate to the server that is specified in the registry URL.
-
Registry Password - Enter the password that you use to authenticate to the server that is specified in the registry URL.
-
-
SSLCertificate - This scheme specifies that SSL client-certificate authentication should be used.
-
-
Registry Type (optional) - Select a registry type for the specific topic:
-
Auto (When you select Auto, Sync attempts to detect the valid schema registry type for the selected topic.)
-
JSON
-
AVRO
-
-
-
MessageOnly - Pushes all information as a single aggregate value on a column named Message.
-
-
Use SSL (optional) - Specify whether you want to use the Secure Sockets Layer (SSL) protocol. The default value is False.
-
-
作成およびテストをクリックして接続を作成します。
-
高度な設定タブで接続の高度な設定を定義します。(ただし、ほとんどの場合これらの設定は必要ありません。)
Plain
-
For the Plain scheme, specify these settings:
-
User - Enter the username that you use to authenticate to your Kafka account.
-
Password - Enter the password that you use to authenticate to your Kafka account.
-
SCRAM
-
For the SCRAM scheme, specify these settings:
-
User - Enter the username that you use to authenticate to your Kafka account.
-
Password - Enter the password that you use to authenticate to your Kafka account.
-
SCRAM-SHA-512
-
For the SCRAM-SHA-512 scheme, specify these settings:
-
User - Enter the username that you use to authenticate to your Kafka account.
-
Password - Enter the password that you use to authenticate to your Kafka account.
-
Kerberos
-
For the Kerberos scheme, specify these settings:
-
User - Enter the username that you use to authenticate to your Kafka account.
-
Password - Enter the password that you use to authenticate to your Kafka account.
-
Kerberos SPN - Enter the service principal name (SPN) for the Kerberos domain controller.
-
Kerberos Keytab File (optional) - Enter the keytab file that contains your pairs of the Kerberos principals and encrypted keys.
-
Use Kerberos Ticket Cache (optional) - Select True to use a ticket cache with the logged-in user instead of a keytab file. The default value is False.
-
SSLCertificate
-
For the SSLCertificate scheme, specify these settings:
-
SSL Client Cert - Enter the SSL client certificate that is used to validate to the XXXXXXX broker.
-
SSL Client Cert Type - Select the format of the SSL client certificate that is used to connect to the XXXXXX broker:
-
JKSFILE
-
PFXFILE
-
PEMKEY_FILE
-
PEMKEY_BLOB
-
-
SSL Client Cert Password - Enter the password that is used to decrypt the SSL client certificate.
-
詳細情報
CData Sync とApache Kafka の連携について、詳しくはApache Kafka Connector for CData Sync を参照してください。