Reading and Writing Spark SQL Data with the SSIS Components

The following sections show how to ETL Spark SQL data, using the standard SSIS components to query Spark SQL tables just as you would SQL Server tables.

Using the Source Component

Using the Source Component explains how to add a source component to the package, as well as how to define a connection manager and select a data access mode.

Using the Destination Component

Using the Destination Component details the process for adding a destination component to the package, connecting the source and destination components, and selecting data operations to be done with the source data.

Using the Lookup Component

Using the Lookup Component demonstrates how to perform data lookups on a specified set of columns from the source component in a lookup component.

Using the Execute SQL Task

Using the Execute SQL Task details the process of adding an Execute SQL task to your project and executing SQL queries directly.

Calling Stored Procedures

Calling Stored Procedures describes how to execute stored procedures with a Script component.