Establishing a Connection

With the CData Cmdlets users can install a data module, set the connection properties, and start scripting. This section provides examples of using our AzureDevOps Cmdlets with native PowerShell cmdlets, like the CSV import and export cmdlets.

Installing and Connecting

If you have PSGet, installing the cmdlets can be accomplished from the PowerShell Gallery with the following command. You can also obtain a setup from the CData site.

Install-Module AzureDevOpsCmdlets

The following line is then added to your profile, loading the cmdlets on the next session:

Import-Module AzureDevOpsCmdlets;

You can then use the Connect-AzureDevOps cmdlet to create a connection object that can be passed to other cmdlets:

$conn = Connect-AzureDevOps - AuthScheme="Basic" Organization="MyAzureDevOpsOrganization" Catalog="Project_dev" Schema="Project"

Connecting to Azure DevOps

To connect to your Azure DevOps account, navigate to Profile > Organizations to obtain the name of your organization in the account. Set the Organization property to this value.

Note: Since table names can exist in multiple catalogs and schemas, when querying a Azure DevOps table, specify the Organization, Catalog, and Schema.

Authenticating to Azure DevOps

Azure DevOps supports both Basic and Azure AD (OAuth-based) authentication.

Basic

When you connect to your Azure DevOps via Basic authentication, you provide both the Organization and a PersonalAccessToken.

To generate a personal access token, log in to your Azure DevOps Organization account and navigate to Profile > Personal Access Tokens > New Token. The generated token displays.

Azure AD

Azure AD is Microsoft’s multi-tenant, cloud-based directory and identity management service. It is user-based authentication that requires that you set AuthScheme to AzureAD and set Organization to the name of your Azure DevOps Organization.

Authentication to Azure AD over a Web application always requires the creation of a custom OAuth application. For details, see Creating an Azure AD Application.

Desktop Applications

CData provides an embedded OAuth application that simplifies connection to Azure AD from a Desktop application.

You can also authenticate from a desktop application using a custom OAuth application. (For further information, see Creating an Azure AD Application.) To authenticate via Azure AD, set these parameters:

AuthScheme: AzureAD.
Custom applications only:
- OAuthClientId: The client Id assigned when you registered your custom OAuth application.
- OAuthClientSecret: The client secret assigned when you registered your custom OAuth application.
- CallbackURL: The redirect URI you defined when you registered your custom OAuth application.

When you connect, the cmdlet opens Azure DevOps's OAuth endpoint in your default browser. Log in and grant permissions to the application.

The cmdlet completes the OAuth process, obtaining an access token from Azure DevOps and using it to request data. The OAuth values are saved in the path specified in OAuthSettingsLocation. These values persist across connections.

When the access token expires, the cmdlet refreshes it automatically.

Headless Machines

To configure the driver with a user account on a headless machine, you must authenticate on another device that has an internet browser.

You can do this in either of the following ways:

Obtain the OAuthVerifier value as described below in Option 1: Obtain and Exchange a Verifier Code.
Install the cmdlet on another machine as described below in Option 2: Transfer OAuth Settings. After you authenticate via the usual browser-based flow, transfer the OAuth authentication values.

Option 1: Obtain and Exchange a Verifier Code

Find the authorization endpoint.

Custom applications only: Set these properties to create the Authorization URL:
- InitiateOAuth: OFF.
- OAuthClientId: The client Id assigned when you registered your application.
- OAuthClientSecret: The client secret assigned when you registered your application.
Custom and embedded applications: Call the GetOAuthAuthorizationURL stored procedure.
1. Open the URL returned by the stored procedure in a browser.
2. Log in and grant permissions to the cmdlet. You are redirected to the callback URL, which contains the verifier code.
3. Save the value of the verifier code. You will use this later to set the OAuthVerifier connection property.
Exchange the OAuth verifier code for OAuth refresh and access tokens.

At the headless machine, set these properties:
- AuthScheme: AzureAD.
- InitiateOAuth: REFRESH.
- OAuthVerifier: The verifier code.
- OAuthSettingsLocation: The location of the file that holds the OAuth token values that persist across connections.
- Custom applications only:
  - OAuthClientId: The client Id in your custom OAuth application settings.
  - OAuthClientSecret: The client secret in the custom OAuth application settings.
After the OAuth settings file is generated, reset the following properties to connect:
- InitiateOAuth: REFRESH.
- OAuthSettingsLocation: The location containing the encrypted OAuth authentication values. Make sure this location grants read and write permissions to the cmdlet to enable the automatic refreshing of the access token.
- Custom applications only:
  - OAuthClientId: The client Id assigned when you registered your application.
  - OAuthClientSecret: The client secret assigned when you registered your application.

Option 2: Transfer OAuth Settings

Before you can connect via a headless machine, you must create and install a connection with the driver on a device that supports an internet browser. Set the connection properties as described above, in Desktop Applications.

After you complete the instructions in Desktop Applications, the resulting authentication values are encrypted and written to the location specified by OAuthSettingsLocation. The default filename is OAuthSettings.txt.

Once you have successfully tested the connection, copy the OAuth settings file to your headless machine.

At the headless machine, set these properties:

AuthScheme: AzureAD.
InitiateOAuth: REFRESH.
OAuthSettingsLocation: The location of your OAuth settings file. Make sure this location gives read and write permissions to the cmdlet to enable the automatic refreshing of the access token.
Custom applications only:
- OAuthClientId: The client Id assigned when you registered your application.
- OAuthClientSecret: The client secret assigned when you registered your application.

Retrieving Data

The Select-AzureDevOps cmdlet provides a native PowerShell interface for retrieving data:

$results = Select-AzureDevOps -Connection $conn -Table "WorkItems" -Columns @("Id, BuildNumber") -Where "Reason='Manual'"

The Invoke-AzureDevOps cmdlet provides an SQL interface. This cmdlet can be used to execute an SQL query via the Query parameter.

Piping Cmdlet Output

The cmdlets return row objects to the pipeline one row at a time. The following line exports results to a CSV file:

Select-AzureDevOps -Connection $conn -Table WorkItems -Where "Reason = 'Manual'" | Select -Property * -ExcludeProperty Connection,Table,Columns | Export-Csv -Path c:\myWorkItemsData.csv -NoTypeInformation

You will notice that we piped the results from Select-AzureDevOps into a Select-Object cmdlet and excluded some properties before piping them into an Export-CSV cmdlet. We do this because the CData Cmdlets append Connection, Table, and Columns information onto each row object in the result set, and we do not necessarily want that information in our CSV file.

However, this makes it easy to pipe the output of one cmdlet to another. The following is an example of converting a result set to JSON:

 
PS C:\> $conn  = Connect-AzureDevOps - AuthScheme="Basic" Organization="MyAzureDevOpsOrganization" Catalog="Project_dev" Schema="Project"
PS C:\> $row = Select-AzureDevOps -Connection $conn -Table "WorkItems" -Columns (Id, BuildNumber) -Where "Reason = 'Manual'" | select -first 1
PS C:\> $row | ConvertTo-Json
{
  "Connection":  {

  },
  "Table":  "WorkItems",
  "Columns":  [

  ],
  "Id":  "MyId",
  "BuildNumber":  "MyBuildNumber"
}

Deleting Data

The following line deletes any records that match the criteria:

Select-AzureDevOps -Connection $conn -Table WorkItems -Where "Reason = 'Manual'" | Remove-AzureDevOps

Modifying Data

The cmdlets make data transformation easy as well as data cleansing. The following example loads data from a CSV file into Azure DevOps, checking first whether a record already exists and needs to be updated instead of inserted.

Import-Csv -Path C:\MyWorkItemsUpdates.csv | %{
  $record = Select-AzureDevOps -Connection $conn -Table WorkItems -Where ("Id = `'"+$_.Id+"`'")
  if($record){
    Update-AzureDevOps -Connection $conn -Table WorkItems -Columns @("Id","BuildNumber") -Values @($_.Id, $_.BuildNumber) -Where "Id  = `'$_.Id`'"
  }else{
    Add-AzureDevOps -Connection $conn -Table WorkItems -Columns @("Id","BuildNumber") -Values @($_.Id, $_.BuildNumber)
  }
}

Cmdlets for Azure DevOps