UseCloudFetch
Specifies whether the provider uses CloudFetch to optimize data transfer for large query result sets in Databricks.
Data Type
bool
Default Value
false
Remarks
When this property is set to true, the connector uses CloudFetch, a mechanism in Databricks that improves performance for large query results by temporarily storing and transferring data through cloud storage rather than the active connection.
When this property is set to false, the connector streams query results directly over the connection.
CloudFetch is most beneficial for queries that return very large result sets. For example, more than one million rows. Enabling it can reduce memory usage and improve data retrieval speed for large-scale operations.