UseDescTableQuery
Specifies whether the provider retrieves table column metadata using a DESC TABLE query instead of the Thrift API.
Data Type
bool
Default Value
true
Remarks
When this property is set to true, the driver issues a DESC TABLE query in Databricks to obtain column information for each table.
When this property is set to false, the driver retrieves column metadata using the Thrift API call GetColumns, which is supported in Apache Spark 3.0.0 and later.
Using the Thrift API can improve metadata query performance, but requires a compatible Spark version. The DESC TABLE query provides broader compatibility across Databricks environments.