UseDescTableQuery
Specifies whether the provider retrieves table column metadata using a DESC TABLE query instead of the Thrift API.
Data Type
bool
Default Value
true
Remarks
When this property is set to true, the add-in issues a DESC TABLE query in Databricks to obtain column information for each table.
When this property is set to false, the add-in retrieves column metadata using the Thrift API call GetColumns, which is supported in Apache Spark 3.0.0 and later.
Using the Thrift API can improve metadata query performance, but requires a compatible Spark version. The DESC TABLE query provides broader compatibility across Databricks environments.