UseCloudFetch Parameter (Connect-Databricks Cmdlet)
Specifies whether the provider uses CloudFetch to optimize data transfer for large query result sets in Databricks.
Syntax
Connect-Databricks -UseCloudFetch SwitchParameter
Data Type
bool
Default Value
false
Remarks
When this property is set to true, the cmdlet uses CloudFetch, a mechanism in Databricks that improves performance for large query results by temporarily storing and transferring data through cloud storage rather than the active connection.
When this property is set to false, the cmdlet streams query results directly over the connection.
CloudFetch is most beneficial for queries that return very large result sets. For example, more than one million rows. Enabling it can reduce memory usage and improve data retrieval speed for large-scale operations.