Establishing a Connection
With the CData Cmdlets users can install a data module, set the connection properties, and start scripting. This section provides examples of using our SFTP Cmdlets with native PowerShell cmdlets, like the CSV import and export cmdlets.
Installing and Connecting
If you have PSGet, installing the cmdlets can be accomplished from the PowerShell Gallery with the following command. You can also obtain a setup from the CData site.
Install-Module SFTPCmdlets
The following line is then added to your profile, loading the cmdlets on the next session:
Import-Module SFTPCmdlets;
You can then use the Connect-SFTP cmdlet to create a connection object that can be passed to other cmdlets:
$conn = Connect-SFTP -RemoteHost 'MySFTPServer'
The CData Cmdlets PowerShell Module for SFTP allows connecting to SFTP servers.
Connecting to an SFTP Server
SFTP can be used to transfer files to and from SFTP servers using the SFTP Protocol. To connect, specify the RemoteHost. SFTP uses the User and Password and public key authentication (SSHClientCert). Choose an SSHAuthMode and specify connection values based on your selection.
Connecting to Data
Set the following connection properties to control the relational view of the file system:
- RemotePath: Set this to the current working directory.
- TableDepth: Set this to control the depth of subfolders to report as views.
- FileRetrievalDepth: Set this to retrieve files recursively and list them in the Root table.
Retrieving Data
The Select-SFTP cmdlet provides a native PowerShell interface for retrieving data:
$results = Select-SFTP -Connection $conn -Table "Notes" -Columns @("Filesize, Filename") -Where "FilePath='/documents/doc.txt'"The Invoke-SFTP cmdlet provides an SQL interface. This cmdlet can be used to execute an SQL query via the Query parameter.
Piping Cmdlet Output
The cmdlets return row objects to the pipeline one row at a time. The following line exports results to a CSV file:
Select-SFTP -Connection $conn -Table Notes -Where "FilePath = '/documents/doc.txt'" | Select -Property * -ExcludeProperty Connection,Table,Columns | Export-Csv -Path c:\myNotesData.csv -NoTypeInformation
You will notice that we piped the results from Select-SFTP into a Select-Object cmdlet and excluded some properties before piping them into an Export-CSV cmdlet. We do this because the CData Cmdlets append Connection, Table, and Columns information onto each row object in the result set, and we do not necessarily want that information in our CSV file.
However, this makes it easy to pipe the output of one cmdlet to another. The following is an example of converting a result set to JSON:
PS C:\> $conn = Connect-SFTP -RemoteHost 'MySFTPServer' PS C:\> $row = Select-SFTP -Connection $conn -Table "Notes" -Columns (Filesize, Filename) -Where "FilePath = '/documents/doc.txt'" | select -first 1 PS C:\> $row | ConvertTo-Json { "Connection": { }, "Table": "Notes", "Columns": [ ], "Filesize": "MyFilesize", "Filename": "MyFilename" }
Deleting Data
The following line deletes any records that match the criteria:
Select-SFTP -Connection $conn -Table Notes -Where "FilePath = '/documents/doc.txt'" | Remove-SFTP
Modifying Data
The cmdlets make data transformation easy as well as data cleansing. The following example loads data from a CSV file into SFTP, checking first whether a record already exists and needs to be updated instead of inserted.
Import-Csv -Path C:\MyNotesUpdates.csv | %{ $record = Select-SFTP -Connection $conn -Table Notes -Where ("Id = `'"+$_.Id+"`'") if($record){ Update-SFTP -Connection $conn -Table Notes -Columns @("Filesize","Filename") -Values @($_.Filesize, $_.Filename) -Where "Id = `'$_.Id`'" }else{ Add-SFTP -Connection $conn -Table Notes -Columns @("Filesize","Filename") -Values @($_.Filesize, $_.Filename) } }