SSIS Components for Parquet

Build 25.0.9434

変更履歴

General Changes

DateBuild
Number
Change
Type
Description
10/06/20259410GeneralAdded
  • ミリ秒とナノ秒に対応する".S" と",S" を使用したdatetime フォーマットのパースに対応しました。
09/12/20259386GeneralAdded
  • sys_tables テーブルにIsInsertable、IsUpdateable、IsDeleteable カラムが追加されました。
09/10/20259384GeneralChanged
  • 静的に定義されたビューのすべてのカラムが読み取り専用としてレポ―トされるようになりました。
09/03/20259377GeneralChanged
  • 射影部分でIN 条件にNULL 値が使用される際の動作が修正されました。0 ではなくNULL が返されるようになりました。例えば、"NULL IN (1,2)" は"NULL" を返します。
09/01/20259375GeneralAdded
  • CAST 関数で無限値を使用するサポートが追加されました。この関数は"inf" および"-inf" をDOUBLE、FLOAT、またはREAL にキャストできます。
08/22/20259365ParquetAdded
  • Added the TestConnectionBehavior connection property.
08/21/20259364GeneralChanged
  • 動作変更:
    • 非テーブルクエリにおける文字列値比較の不整合が修正されました。
    • 例えば、"SELECT 'A' = 'a'" は以前はfalse を返していましたが、現在はtrue を返します。
08/13/20259356GeneralChanged
  • ヒープ使用量を削減するため、ページプロバイダーでメモリに保持される最大ページ数が15から5に変更されました。
07/28/20259340ParquetAdded
  • Added support for Byte Stream Split encoding for read operations. Supported data types include: Float, Double, Integer, Long, and Fixed Length Byte Array (FLBA).
07/18/20259330ParquetRemoved
  • Removed the OAuthGrantType property. The grant type is now set implicitly through the 'AuthScheme' property. For example, you can use the 'OAuthPassword' AuthScheme instead of AuthScheme=OAuth with OAuthGrantType=Password.
06/25/20259307GeneralRemoved
  • ConnectionType プロパティから"ADLS Gen 1" の値が削除されました。
06/20/20259302GeneralAdded
  • 以下の関数が作成されました:
    • TEXT_ENCODE:文字列を異なる文字セットにエンコードします(UTF8 → UTF7)。結果としてバイナリ配列を返します。
    • TEXT_DECODE:バイナリ配列を受け取り、文字セットが指定された場合に文字列にデコードして戻します。
    • BASE64_ENCODE:バイナリ配列を受け取り、base64 文字列(varchar)としてエンコードします。
    • BASE64_DECODE:base64 エンコードされた文字列を受け取り、バイナリ配列にデコードします。
06/18/20259300GeneralChanged
  • 例外処理の内部コードがリファクタリングされました。特定のエラー条件で返される例外メッセージの表現や書式が変更されている場合があります。
06/12/20259294ParquetAdded
  • Added the following stored procedures: UploadFile, DownloadFile, and DeleteFile. These stored procedures accept only file paths that are relative to the connection URI. Note that UploadFile and DownloadFile are not available for ConnectionType=Local.
06/09/20259291ParquetRemoved
  • Removed the ProjectId property for the Google Cloud Storage ConnectionType.
05/27/20259278GeneralRemoved
  • ProxyAuthscheme から"Proprietary" 列挙オプションが削除されました。
05/27/20259278SSISRemoved
  • C# 実装のSQLite のサポートが削除されました。以前、この実装をデフォルトで使用していた機能(AutoCache やEF6 スキーマキャッシュなど)は、今後はネイティブのSQLite ドライバーが必要になります。
05/15/20259266ParquetAdded
  • Added support for reading .7z (7-Zip) archive files.
04/07/20259228ParquetAdded
  • Added support for the IAMSecretKey AuthScheme for cloud storage connections that use access and secret key credentials. This naming better reflects the underlying authentication method and aligns with terminology used by cloud storage providers.

Deprecated
  • Deprecated the HMAC AuthScheme. While it remains supported for backward compatibility, it is no longer recommended due to naming ambiguity.
02/15/20259177GeneralAdded
  • 符号なし整数型(unsigned integer type)を、その符号なしの値を保持するのに十分な精度を持つ最も近い符号付きデータ型に変換するサポートが追加されました。これは、JDBC が符号なしデータ型をサポートしていないため、JDBC に対してのみ行われます。
02/11/20259173ParquetAdded
  • Added support for unsigned data types, the Float16 logical data type, and delta-based encodings.
11/27/20249097GeneralAdded
  • LogModule の出力にThreadId が追加されました。Logfile の行には、実行中のアクションに関連するThread ID が含まれるようになりました。
10/15/20249054ParquetReplaced
  • In the ListFiles stored procedure, replaced the AbsolutePath input with the Path input. This path is relative to the path provided in the URI connection property.
09/30/20249039ParquetAdded
  • Added the ListFiles stored procedure. By default, this procedure lists all Parquet files in the directory specified by the URI connection property. If an alternative directory is supplied in the AbsolutePath input, this procedure will instead list all Parquet files in the supplied directory.
08/23/20249001ParquetAdded
  • Added OAuthPKCE as an authentication option when ConnectionType is set to Google Cloud Storage and Google Drive.
  • Added OAuthClient as an authentication option when ConnectionType is set to Box.
08/20/20248998ParquetAdded
  • Added support for the following AWS regions: HYDERABAD, MELBOURNE, CALGARY, SPAIN, ISOLATEDUSEAST, ISOLATEDUSEASTB, and ISOLATEDUSWEST.
06/28/20248945ParquetRemoved
  • Removed the value "Auto" from the ConnectionType connection property. The default value is now "Local".
06/18/20248935GeneralAdded
  • AWSRegion 接続プロパティに"TELAVIV" リージョン(Israel)のサポートが追加されました。
05/31/20248917ParquetChanged
  • The format of the file name generated by the Relational data model now always includes the name of the originating file, prepended to the table name. For example, for the file 'github.parquet', the names of the tables generated by the Relational data model have the format 'github.tablename'.
05/09/20248895GeneralChanged
  • 以前はROUND 関数は負の値を受け取りませんでした。その機能は復元されました。
03/15/20248840GeneralAdded
  • Java のString.compare() 機能をSQL クエリに提供するSTRING_COMPARE という新しいSQL 関数が作成されました。2つの文字列の比較値を表す数値を返します。
11/29/20238733GeneralChanged
  • The ROUND function doesn't accept the negative precision values anymore.

Changed
  • The returning types of the FDMonth, FDQuarter, FDWeek, LDMonth, LDQuarter, LDWeek functions are changed from Timestamp to Date.
  • The return type of the ABS function will be consistent with the parameter value type.
11/28/20238732GeneralAdded
  • Added the HMACSHA256 formatter to allow for secrets to be decoded if it is in base64 format
08/14/20238626ParquetAdded
  • Added AzureServicePrincipalCert as a separate AuthScheme to be used for Azure Service Principal authentication with a Certificate.
06/20/20238571GeneralAdded
  • Added the new sys_lastresultinfo system table.
05/11/20238531SSISRemoved
  • Removed support for SQL Server Integration Services 2012 and Visual Studio 2012/2013.
04/25/20238515GeneralRemoved
  • Removed support for the SELECT INTO CSV statement. The core code doesn't support it anymore.
12/14/20228383GeneralChanged
  • Added the Default column to the sys_procedureparameters table.
12/05/20228374SSISAdded
  • Added support for SQL Server Integration Services 2022 and Visual Studio 2022
09/30/20228308GeneralChanged
  • Added the IsPath column to the sys_procedureparameters table.
08/30/20228277ParquetAdded
  • Added support for uploading server-side encrypted objects for Amazon S3 storage source via ServerSideEncryption connection property.
08/18/20228265SSISChanged
  • Changed Azure module to Az module.
07/22/20228238ParquetRemoved
  • Removed the ParallelPagingSizeLimit connection property.
06/21/20228207ParquetChanged
  • Return an empty table list instead of throwing error when a folder is devoid of Parquet files.
05/27/20228182ParquetAdded
  • Added the ConnectionType connection property to determine the storage type of specified URI.
05/09/20228164ParquetAdded
  • Added write support (CREATE TABLE and INSERT INTO) for storage sources.
03/10/20228104ParquetAdded
  • Added support for Apache HDFS (webhdfs://) as a storage source.
03/09/20228103ParquetChanged
  • Changed the default method for submitting client_credentials grants with OAuth. Before client_credentials would submit OAuthClientId and OAuthClientSecret using the HTTP Authorization header. Now the OAuthPasswordGrantType controls this setting and it defaults to OAuthPasswordGrantType=Post. The previous behavior is still available by setting OAuthPasswordGrantType=Basic.
01/13/20228048ParquetAdded
  • Added support for IBM Cloud Object Storage (ibmobjectstorage://) as a storage source.
10/07/20217950ParquetAdded
  • Added support for excluding files based on the ExcludeFiles connection property.
  • Added support for datetime filters in IncludeFiles and ExcludeFiles connection properties. We currently support CreatedDate and ModifiedDate. Ex:
    ExcludeFiles="TXT,CreatedDate<='2020-11-26T07:39:34-05:00'" 
    ExcludeFiles="TXT,ModifiedDate<=DATETIMEFROMPARTS(2020, 11, 26, 7, 40, 50, 000)"
    ExcludeFiles="ModifiedDate>=DATETIMEFROMPARTS(2020, 11, 26, 7, 40, 49, 000),ModifiedDate<=CURRENT_TIMESTAMP()" 
  • Only the following storage sources will have support for filtering by CreatedDate:
    • Box (box://)
    • GCloudStorage (gs://)
    • GoogleDriveStorageSource (gdrive://)
    • OneDrive (onedrive://)
    • SharePoint (sp://)
    • SharePointREST (sprest://)
09/02/20217915GeneralAdded
  • Added support for the STRING_SPLIT table-valued function in the CROSS APPLY clause.
08/07/20217889GeneralChanged
  • Added the KeySeq column to the sys_foreignkeys table.
08/06/20217888GeneralChanged
  • Added the new sys_primarykeys system table.
07/23/20217874GeneralChanged
  • Updated the Literal Function Names for relative date/datetime functions. Previously, relative date/datetime functions resolved to a different value when used in the projection as opposed to the predicate. For example: SELECT LAST_MONTH() AS lm, Col FROM Table WHERE Col > LAST_MONTH(). Formerly, the two LAST_MONTH() methods would resolve to different datetimes. Now, they will match.
  • As a replacement for the previous behavior, the relative date/datetime functions in the criteria may have an 'L' appended to them. For example: WHERE col > L_LAST_MONTH(). This will continue to resolve to the same values that were previously calculated in the criteria. Note that the "L_" prefix will only work in the predicate - it not available for the projection.
07/22/20217873SSISAdded
  • Added a UI type editor for the SQLStatement property of the SQLExecutor component.
06/24/20217845ParquetAdded
  • Added support for the GOOGLEJSONBLOB JWT certificate type. This works like the existing GOOGLEJSON certificate type except that the certificate is provided as JSON text instead of as a file path.
06/08/20217829ParquetAdded
  • Added support for the AzureServicePrinciple authentication scheme, which will support both using an OAuthClientSecret, or alternatively using a JWT cert.
06/05/20217826ParquetAdded
  • Added support to authenticate submitting JWT certs instead of the OAuthClientSecret for the AzureAD authentication scheme.
05/26/20217816SSISAdded
  • Added support for semicolon-separated SQL queries.
04/23/20217783GeneralChanged
  • Updated how display sizes are determined for varchar primary key and foreign key columns so they will match the reported length of the column.
04/23/20217783ParquetDeprecated
  • SSODomain will not be used anymore for OKTA, OneLogin and ADFS. Instead, Domain should be specified.
  • The AzureAccount connection property is deprecated. Instead, AzureStorageAccount should be used.
04/16/20217776GeneralChanged
  • Reduced the length to 255 for varchar primary key and foreign key columns.

Changed
  • Updated index naming convention to avoid duplicates.
04/16/20217776SSISAdded
  • Added a create table button for the Destination Component to make it easier to add a new destination in SSIS.
  • Improved user experience for Source Component by allowing users to select columns via a new checkbox dialog.

Changed
  • Improved query dialog for building parameterized statements.
04/15/20217775GeneralChanged
  • Kerberos authentication is updated to use TCP by default, but will fall back to UDP if a TCP connection cannot be established.
01/14/20217684ParquetAdded
  • Added Insert / Update support.
12/23/20207662ParquetChanged
  • Added performance improvements for file parsing.

Copyright (c) 2025 CData Software, Inc. - All rights reserved.
Build 25.0.9434