Data Model
The component leverages Spark Thrift to enable bidirectional SQL access to Spark SQL data. It supports Spark SQL version 1.6 and above.
Discovering Schemas
The CData SSIS Components for Spark SQL dynamically obtains the Spark SQL schemas; reconnect to pick up any metadata changes, such as added or removed columns or changes in data type.