CData Cmdlets for Spark SQL

Overview

The CData Cmdlets PowerShell Module for Spark SQL allows developers to write PowerShell scripts with connectivity to Spark SQL. The cmdlets abstract the underlying data source into tables, views, and stored procedures that can be used to both retrieve and update data. The representation of Spark SQL as a relational database gives the cmdlets a uniform interface and also enables you to execute SQL to Spark SQL.

Key Features

• Real-time access to Spark SQL data in Windows PowerShell, with comprehensive support for create, read, update, and delete (CRUD) operations.
• Pipe row objects directly from Spark SQL into other cmdlets as input.
• Streamlined installation via the Powershell Gallery.

Getting Started

See Getting Started for an overview of how to connect to and query Spark SQL data from PowerShell.

Spark SQL Cmdlets

See the Spark SQL Cmdlets section for a list of available Spark SQL cmdlets, including their syntax and input parameters.

Advanced Features

Advanced Features details additional features supported by the cmdlet, such as defining user defined views, ssl configuration, remoting, caching, firewall/proxy settings, and advanced logging.

SQL Compliance

See SQL Compliance for a syntax reference and code examples outlining the supported SQL.

Data Model

Data Model lists the tables, views, and stored procedures available for the cmdlets.