Connecting to Databricks

Establishing a Connection shows how to authenticate to Databricks and configure any necessary connection properties. You can also configure cmdlet capabilities through the available Connection properties, from data modeling to firewall traversal. The Advanced Settings section shows how to set up more advanced configurations and troubleshoot connection errors.

Connecting from PowerShell

The CData Cmdlets PowerShell Module for Databricks provides a familiar way to interact with Databricks from PowerShell. The cmdlets provide a standard PowerShell interface and an SQL interface to live data. The CData cmdlets enable you to work with Databricks using standard PowerShell objects; you can chain the cmdlets to each other or other cmdlets in pipelines. The cmdlets also support PowerShell debug streams.

Data Manipulation with Cmdlets

See Establishing a Connection to learn how to get started with the Connect-Databricks cmdlet. You can then pass the DatabricksConnection object returned to other cmdlets for accessing data:

• Select-Databricks
• Add-Databricks
• Update-Databricks
• Remove-Databricks

Executing SQL from PowerShell

You can execute any SQL query with the Invoke-Databricks cmdlet.

Accessing Debug Output from Streams

See Capturing Errors and Logging to obtain the debug output through PowerShell streams.

PowerShell Version Support

The standard cmdlets are supported in PowerShell 2, 3, 4, and 5.

Databricks Version Support

The CData Cmdlets PowerShell Module for Databricks leverages Databricks Thrift to enable bidirectional SQL access to Databricks data. The cmdlet supports databases that run Databricks Runtime Version 9.1 and later. It also supports the Pro and Classic Databricks SQL versions. The data model is fully dynamic and automatically reflects the data that is available in your Databricks environment. Any updates to tables or schemas are immediately accessible through SQL.