Search

Azure Data Lake Storage

Version 23.4.8843

Azure Data Lake Storage

You can use the Azure Data Lake Storage connector from the CData Sync application to capture data from Azure Data Lake Storage and move it to any supported destination. To do so, you need to add the connector, authenticate to the connector, and complete your connection.

Establish a Connection

To allow Sync to use data from Azure Data Lake Storage, you first must establish a connection to Azure Data Lake Storage. Follow these steps to connect Azure Data Lake Storage to your Sync account:

  1. Open the Connections page of the Sync dashboard.

  2. Click Add Connection to open the Select Connectors page.

  3. Click the Sources tab and locate the Azure Data Lake Storage row.

  4. Click the Configure Connection icon at the end of that row. If you do not see the Configure Connection icon, you need to add the connector according to the instructions in Connections.

  5. Enter connection settings on the Settings tab:

    • Connection Name - Enter a connection name of your choice.

    • Azure Storage Account - Enter the name of your Azure storage account.

    • Auth Scheme - Select your authentication scheme below to proceed to the relevant section for your scheme. Then fill out the settings as specified in that section.

    • File Format - Select the file format that you want to use. The default value is CSV.

    • File System (optional) - Enter the name of the FileSystem that will be used in a Gen 2 account.

  6. Click Connect to Azure Data Lake Storage to connect to Azure Data Lake Storage.

  7. Click Create & Test to create the connection.

  8. Define advanced connection settings on the Advanced tab. (In most cases, though, you should not need these settings.)

AzureAD

For the AzureAD scheme:

  1. Click Connect to Azure Data Lake Storage to connect to Azure Data Lake Storage.

  2. Complete the remaining steps.

AzureServicePrincipal

  1. For the AzureServicePrincipal scheme, specify these settings:

    • Azure Tenant - Enter the Microsoft Online tenant that is being used to access data. If you do not specify a tenant, Sync uses the default tenant.

    • OAuth Client Id - Enter the client Id that you were assigned when you registered your application with an OAuth authorization server.

    • OAuth Client Secret - Enter the client secret that you were assigned when you registered your application with an OAuth authorization server.

  2. Click Connect to Azure Data Lake Storage to connect to Azure Data Lake Storage.

  3. Complete the remaining steps.

AzureMSI

For the AzureMSI scheme:

  1. Click Connect to Azure Data Lake Storage to connect to Azure Data Lake Storage.

  2. Complete the remaining steps.

AccessKey

  1. For the AccessKey scheme, enter the storage key that is associated with your Azure account into the Azure Access Key field.

  2. Complete the remaining steps.

SAS

  1. For the SAS scheme, enter a shared access-key signature in the Azure Shared Access Signature field. The access-key signature is used for authentication.

  2. Complete the remaining steps.

More Information

For more information about interactions between CData Sync and Azure Data Lake Storage, see Azure Data Lake Storage Connector for CData Sync.