Connecting to Spark SQL

Establishing a Connection shows how to authenticate to Spark SQL and configure any necessary connection properties from the Connection Manager window.

You can also configure component capabilities through the available Connection properties, from data modeling to firewall traversal. The Advanced Settings section shows how to set up more advanced configurations and troubleshoot connection errors.

Visual Studio Version Support

The CData SSIS Components for Spark SQL supports Visual Studio versions 2015 and above.

SSIS Version Support

The CData SSIS Components for Spark SQL provide data flow components that allow for straightforward integration with Spark SQL data from SSIS data flow tasks. SQL Server 2014, 2016, 2017, 2019, and 2022 are supported including their corresponding version of SQL Server Data Tools.

Spark SQL Version Support

The component leverages Spark Thrift to enable bidirectional SQL access to Spark SQL data. It supports Spark SQL version 1.6 and above.

See Also

• Using the Source Component: Pull Spark SQL data into your data flow task.
• Using the Destination Component: Push data to Spark SQL.
• Deploying to Azure: Deploy the CData components to Azure from Visual Studio.
• Troubleshooting: The component installation automatically adds the components to the toolbox; if you do not see the components, you can find the procedure to add them here.