SSIS Components for Azure Data Lake Storage

Build 24.0.9060

Changelog

General Changes

DateBuild
Number
Change
Type
Description
05/29/20248915Azure Data Lake StorageRemoved
  • The Auto AuthScheme (formerly the default AuthScheme for this data source) has been removed.

Changed
  • The default AuthScheme is now AzureAD.
05/16/20248902Azure Data Lake StorageRemoved
  • Removed the Resources table. Users can no longer run a 'SELECT * FROM Resources' query. Instead, they can specify the 'FileSystem' connection property in the connection string by adding a value for 'fileSystemName'. This creates a new table called '(fileSystemName0_resources)' that contains the same metadata as the 'Resources' table did.
05/09/20248895GeneralChanged
  • The ROUND function previously did not accept negative precision values. That feature has now been restored.
03/18/20248843Azure Data Lake StorageAdded
  • Added FileContent input, accepting Base64-encoded text, to the UploadFile stored procedure.
03/15/20248840GeneralAdded
  • Created a new SQL function called STRING_COMPARE that provides java's String.compare() ability to SQL queries. Returns a number representative of the compared value of two strings
01/18/20248783Azure Data Lake StorageAdded
  • Added FileSystems table, which retrieves a list of the filesystems.
  • Added CreateFileSystem, DeleteFileSystem, GetFileSystemProperties, SetFileSystemProperties stored procedures, which allow to create, delete and work with a specified filesystem's properties.

Changed
  • FileSystem connection property is changed to be unrequired.
11/29/20238733GeneralChanged
  • The ROUND function doesn't accept the negative precision values anymore.

Changed
  • The returning types of the FDMonth, FDQuarter, FDWeek, LDMonth, LDQuarter, LDWeek functions are changed from Timestamp to Date.
  • The return type of the ABS function will be consistent with the parameter value type.
11/28/20238732GeneralAdded
  • Added the HMACSHA256 formatter to allow for secrets to be decoded if it is in base64 format
07/28/20238609Azure Data Lake StorageAdded
  • Added AzureServicePrincipalCert as a separate AuthScheme to be used for Azure Service Principal authentication with a Certificate.
06/20/20238571GeneralAdded
  • Added the new sys_lastresultinfo system table.
05/11/20238531SSISRemoved
  • Removed support for SQL Server Integration Services 2012 and Visual Studio 2012/2013.
04/25/20238515GeneralRemoved
  • Removed support for the SELECT INTO CSV statement. The core code doesn't support it anymore.
12/14/20228383GeneralChanged
  • Added the Default column to the sys_procedureparameters table.
12/05/20228374SSISAdded
  • Added support for SQL Server Integration Services 2022 and Visual Studio 2022
09/30/20228308GeneralChanged
  • Added the IsPath column to the sys_procedureparameters table.
08/31/20228278Azure Data Lake StorageAdded
  • Added binary input support for AppendToFile (ADLSGen1). Added 'Stream' as an input.
  • Added binary and encoded content output support for DownloadFile (ADLSGen1). Added 'Encoding' as an input and 'FileStream' as inputs.
  • Added binary input support for UploadFile (ADLSGen1). Added 'Stream' as an input.
  • Added binary and encoded content output support for DownloadFile (ADLSGen2). Added 'FileStream' as an input, and 'FileData' as an output.
  • Added binary input support for UploadFile (ADLSGen2). Added 'Content' as an input.
08/18/20228265SSISChanged
  • Changed Azure module to Az module.
01/14/20228049Azure Data Lake StorageChanged
  • The UploadFile stored procedure now accepts a folder as a parameter for the Path and FilePath arguments. All the files inside that folder are uploaded to the destination path in parallel. This is not recursive, so the files in the sub folders will not be uploaded.
01/11/20228046Azure Data Lake StorageChanged
  • The DeleteObject stored procedure now has an additional feature where you can specify a folder and delete only the files inside that folder.
11/25/20217999Azure Data Lake StorageChanged
  • Changed the Primary Key Column for the ADLSGen2.Resources view from ETag to Name. ETag is not unique, but Name is.
11/24/20217998Azure Data Lake StorageAdded
  • Added the Resources.Directory column to the ADLSGen2 Schema. This column supports server side filtering and can be used to list the files in the specified Directory.
09/02/20217915GeneralAdded
  • Added support for the STRING_SPLIT table-valued function in the CROSS APPLY clause.
08/07/20217889GeneralChanged
  • Added the KeySeq column to the sys_foreignkeys table.
08/06/20217888GeneralChanged
  • Added the new sys_primarykeys system table.
07/23/20217874GeneralChanged
  • Updated the Literal Function Names for relative date/datetime functions. Previously, relative date/datetime functions resolved to a different value when used in the projection as opposed to the predicate. For example: SELECT LAST_MONTH() AS lm, Col FROM Table WHERE Col > LAST_MONTH(). Formerly, the two LAST_MONTH() methods would resolve to different datetimes. Now, they will match.
  • As a replacement for the previous behavior, the relative date/datetime functions in the criteria may have an 'L' appended to them. For example: WHERE col > L_LAST_MONTH(). This will continue to resolve to the same values that were previously calculated in the criteria. Note that the "L_" prefix will only work in the predicate - it not available for the projection.
07/22/20217873SSISAdded
  • Added a UI type editor for the SQLStatement property of the SQLExecutor component.
06/05/20217826Azure Data Lake StorageAdded
  • Added support for the AzureServicePrinciple authentication scheme.
  • Added support to authenticate submitting JWT certs instead of the OAuthClientSecret for the AzureServicePrinciple and AzureAD authentication schemes.
05/26/20217816SSISAdded
  • Added support for semicolon-separated SQL queries.
04/23/20217783GeneralChanged
  • Updated how display sizes are determined for varchar primary key and foreign key columns so they will match the reported length of the column.
04/16/20217776GeneralChanged
  • Reduced the length to 255 for varchar primary key and foreign key columns.

Changed
  • Updated index naming convention to avoid duplicates.
04/16/20217776SSISAdded
  • Added a create table button for the Destination Component to make it easier to add a new destination in SSIS.
  • Improved user experience for Source Component by allowing users to select columns via a new checkbox dialog.

Changed
  • Improved query dialog for building parameterized statements.

Copyright (c) 2024 CData Software, Inc. - All rights reserved.
Build 24.0.9060