CData Python Connector for Azure Data Lake Storage

Build 25.0.9454

ChunkSize

The size of chunks (in MB) to use when uploading large files.

Data Type

int

Default Value

16

Remarks

This property determines the size, in megabytes, of each data block the connector uploads when transferring large files to Azure Data Lake Storage Gen2.

If this property is left unset, the connector uses the default value: 16 MB.

If a file exceeds the chunk size, it is divided into multiple blocks of the specified size and uploaded sequentially.

Increasing the chunk size can improve upload performance for large files, but may increase memory usage. Decreasing it can reduce memory use, but may result in slower uploads.

This setting is only applied to upload operations and does not affect file downloads.

Copyright (c) 2025 CData Software, Inc. - All rights reserved.
Build 25.0.9454