Data Model
The adapter leverages Spark Thrift to enable bidirectional SQL access to Spark SQL data. It supports Spark SQL version 1.6 and above.
Discovering Schemas
The SparkSQL Adapter dynamically obtains the SparkSQL schemas; reconnect to pick up any metadata changes, such as added or removed columns or changes in data type.