Establishing a Connection
Enabling SSIS in Visual Studio 2022
If you're using Visual Studio 2022, you will need to install the SQL Server Integration Services Projects extension to use SSIS.
- Navigate to Extensions > Manage Extensions.
- In the Manage Extensions window's search box, search for "SQL Server Integration Services Projects 2022" and select the extension in the list.
- Click Download.
- Close Visual Studio and run the downloaded Microsoft.DataTools.IntegrationServices.exe installer. Proceed through the installer with default settings.
- Open Visual Studio. There should now be an "Integration Services Project" project template available.
Adding the Bitbucket Connection Manager
Create a new connection manager as follows:
- Create a Visual Studio project with the "Integration Services Project" template.
- In the project, right-click within the Connection Managers window and select New Connection from the menu.
- In the Description column, select CData Bitbucket Connection Manager and click Add...
- Configure the component as described in the next section.
Alternatively, if you have an existing project and CData Bitbucket Source or CData Bitbucket Destination:
- Right-click your CData Bitbucket source or destination component in your data flow
- Select Edit... to open an editor window.
- Click the New... button next to the Connection manager: dropdown selector to create a connection manager.
- Configure the component as described in the next section.
Connecting to Bitbucket
For most queries, you must set the Workspace. The only exception to this is the Workspaces table, which does not require this property to be set, as querying it provides a list of workspace slugs that can be used to set Workspace. To query this table, you must set Schema to 'Information' and execute the query 'SELECT * FROM Workspaces'.
Setting Schema to 'Information' displays general information. To connect to Bitbucket, set these parameters:
- Schema: To show general information about a workspace, such as its users, repositories, and projects, set this to Information. Otherwise, set this to the schema of the repository or project you are querying. To get a full set of available schemas, query the sys_schemas table.
- Workspace: Required if you are not querying the Workspaces table.
This property is not required for querying the Workspaces table, as that query only returns a list of workspace slugs that can be used to set Workspace.
To query the Workspaces table, set Schema to Information and execute:SELECT * FROM Workspace
Authenticating to Bitbucket
Bitbucket supports OAuth authentication only. To enable this authentication from all OAuth flows, you must create a custom OAuth application, and set AuthScheme to OAuth.The following subsections describe how to authenticate to Bitbucket from three common authentication flows.
For information about how to create a custom OAuth application, see Creating a Custom OAuth Application.
For a complete list of connection string properties available in Bitbucket, see Connection.
Desktop Applications
To connect via a desktop application, you must set and refresh the OAuth acess token.Get and Refresh the OAuth Access Token
After setting the following, you are ready to connect:
- InitiateOAuth: GETANDREFRESH. Used to automatically get and refresh the OAuthAccessToken.
- OAuthClientId: The Key displayed when you created your custom OAuth application.
- OAuthClientSecret: The Secret displayed when you created your custom OAuth application.
- CallbackURL: The Callback URL defined when you registered your application. This is typically set to http://localhost:33333.
When you connect, the component opens Bitbucket's OAuth endpoint in your default browser. Log in and grant permissions to the application.
After you grant permissions to the application the component then completes the OAuth process:
- The component obtains an access token from Bitbucket and uses it to request data.
- The OAuth values are saved in the path specified in OAuthSettingsLocation. These values persist across connections.
When the access token expires, the component refreshes it automatically.
Automatic Refresh of the OAuth Access Token
To have the component automatically refresh the OAuth access token:
- Before connecting to data for the first time, set these connection parameters:
- InitiateOAuth: REFRESH.
- OAuthClientId: The Key displayed when you created your custom OAuth application.
- OAuthClientSecret: The Secret displayed when you created your custom OAuth application.
- OAuthAccessToken: The access token returned by GetOAuthAccessToken.
- OAuthSettingsLocation: The path where you want the component to save the OAuth values, which persist across connections.
- On subsequent data connections, set:
- InitiateOAuth
- OAuthSettingsLocation
Manual refresh of the OAuth access token:
The only value needed to manually refresh the OAuth access token is the OAuth refresh token.
- To manually refresh the OAuthAccessToken after the ExpiresIn period (returned by GetOAuthAccessToken) has elapsed, call the RefreshOAuthAccessToken stored procedure.
- Set these connection properties:
- OAuthClientId: The Client Id in your custom OAuth application settings.
- OAuthClientSecret: The Client Secret in your custom OAuth application settings.
- Call RefreshOAuthAccessToken with OAuthRefreshToken set to the OAuth refresh token returned by GetOAuthAccessToken.
- After the new tokens have been retrieved, set the OAuthAccessToken property to the value returned by RefreshOAuthAccessToken. This opens a new connection.
Store the OAuth refresh token so that you can use it to manually refresh the OAuth access token after it has expired.
Headless Machines
To configure the driver to use OAuth with a user account on a headless machine, you need to authenticate on another device that has an internet browser.
Note: Depending on whether AuthScheme is set to code or client, authentication is performed with either an authorization code or a client credentials grant type.
You can do this in either of the following ways:
- Option 1: Obtain the OAuthVerifier value.
- Option 2: Install the component on a machine with an internet browser and transfer the OAuth authentication values after you authenticate through the usual browser-based flow.
After you execute either Option 1 or Option 2, configure the component to automatically refresh the access token on the headless machine.
Option 1: Obtain and Exchange a Verifier Code
To obtain a verifier code, you must authenticate at the OAuth authorization URL as follows:
-
Authenticate from the machine with an internet browser and obtain the OAuthVerifier connection property.
Set these properties:
- InitiateOAuth: OFF.
- OAuthClientId: The Key displayed when you created your custom OAuth application.
- OAuthClientSecret: The Secret displayed when you created your custom OAuth application.
-
Call the GetOAuthAuthorizationURL stored procedure. The stored procedure returns the CallbackURL established when the custom OAuth application was registered. (See Creating a Custom OAuth Application.)
Copy this URL and paste it into a new browser tab.
-
Log in and grant permissions to the component. The OAuth application redirects you the redirect URI, with a parameter called code appended. Note the value of this parameter; you will need it later, to configure the OAuthVerifier connection property.
-
Exchange the OAuth verifier code for OAuth refresh and access tokens.
On the headless machine, to obtain the OAuth authentication values, set these properties:
- InitiateOAuth: REFRESH.
- OAuthVerifier: The verifier code (the value of the code parameter in the Callback URL).
- OAuthClientId: The Key displayed when you created your custom OAuth application.
- OAuthClientSecret: The Secret displayed when you created your custom OAuth application.
- OAuthSettingsLocation: Persist the encrypted OAuth authentication values to the specified location.
-
Test the connection to generate the OAuth settings file.
-
You are ready to connect after you re-set these properties:
- InitiateOAuth: REFRESH.
- OAuthClientId: The Key displayed when you created your custom OAuth application.
- OAuthClientSecret: The Secret displayed when you created your custom OAuth application.
- OAuthSettingsLocation: The location containing the encrypted OAuth authentication values. To enable the automatic refreshing of the access token, be sure that this file gives read and write permissions to the component.
Option 2: Transfer OAuth Settings
Prior to connecting on a headless machine, you must install and create a connection with the driver on a device that supports an internet browser. Set the connection properties as described above in "Desktop Applications".
After completing the instructions in "Desktop Applications", the resulting authentication values are encrypted and written to the path specified by OAuthSettingsLocation. The default filename is OAuthSettings.txt.
Test the connection to generate the OAuth settings file, then copy the OAuth settings file to your headless machine.
To connect to data via the headless machine, set these connection properties:
- InitiateOAuth: REFRESH.
- OAuthClientId: The Secret displayed when you created your custom OAuth application.
- OAuthSettingsLocation: The location of the OAuth settings file you copied from the machine with the browser. To enable automatic refreshing of the access token, ensure that this file gives read and write permissions to the component.