SSIS Components for Databricks

Build 24.0.9062

変更履歴

General Changes

DateBuild
Number		Change
Type		Description
09/26/20249035DatabricksAdded
  • ユーザー対マシン認証をサポートする新AuthScheme OAuthU2M が追加されました。
  • マシン間認証をサポートする新AuthScheme OAuthM2M が追加されました。
  • 生成されたアクセストークンの有効範囲を指定する新しい接続プロパティOAuthLevel が追加されました。許可されるエントリは、WorkspaceLevel およびAccountLevel です。
  • 新しい接続プロパティDatabricksAccountId が追加されました。これはDatabricks アカウントID を指定するプロパティで、OAuthU2MLevel がAccountLevel の場合のみ必須です。
08/20/20248998DatabricksAdded
  • 次のAWS リージョンのサポートが追加されました：HYDERABAD、MELBOURNE、CALGARY、SPAIN、ISOLATEDUSEAST、ISOLATEDUSEASTB、およびISOLATEDUSWEST。
08/02/20248980DatabricksAdded
  • 新たに接続プロパティServerTimezone が追加され、現在のプラットフォームのタイムゾーンIDを指定できるようになりました。UTC（デフォルト）、LOCAL、ユーザー指定のタイムゾーンから選択できます。
07/05/20248952DatabricksDeprecated
  • 以下のプロパティが廃止されました：AzureSubscriptionId、AzureResourceGroup、およびAzureWorkspace。これらのプロパティは、AzureServicePrincipal 認証を使用する際に不要になりましたが、互換性のために残されます。
06/18/20248935DatabricksChanged
  • "UseUploadAPI" 接続プロパティが有効な場合に、バッチINSERT 操作のパフォーマンスが向上しました。
05/09/20248895GeneralChanged
  • 以前はROUND 関数は負の値を受け取りませんでした。その機能は復元されました。
03/21/20248846DatabricksChanged
  • "QueryAllMetadata" プロパティの動作が変更されました。このプロパティがFalse で"Database" プロパティが空の場合、ドライバーはデフォルトカタログ配下のデフォルトスキーマ/データベースだけでなく、すべてのスキーマ/データベースからメタデータをクエリします。
03/15/20248840GeneralAdded
  • Java のString.compare() 機能をSQL クエリに提供するSTRING_COMPARE という新しいSQL 関数が作成されました。2つの文字列の比較値を表す数値を返します。
11/29/20238733GeneralChanged
  • The ROUND function doesn't accept the negative precision values anymore.

Changed
  • The returning types of the FDMonth, FDQuarter, FDWeek, LDMonth, LDQuarter, LDWeek functions are changed from Timestamp to Date.
  • The return type of the ABS function will be consistent with the parameter value type.
11/28/20238732GeneralAdded
  • Added the HMACSHA256 formatter to allow for secrets to be decoded if it is in base64 format
10/20/20238693DatabricksAdded
  • Support Bulk Update and Bulk Delete for Databricks SQL Endpoint(SQL Warehouse).
08/24/20238636DatabricksChanged
  • Support new AuthScheme "Basic", set this to authenticate with Databricks' user and access token.
07/20/20238601DatabricksAdded
  • Add new property "QueryAllMetadata" to specify whether to query all catalogs and schemas(databases) or only the default catalog and schema(database).
06/20/20238571GeneralAdded
  • Added the new sys_lastresultinfo system table.
06/08/20238559DatabricksChanged
  • The default value of the "UseLegacyDataModel" property has been changed to True, indicating that the driver now supports multi-catalog by default.
05/15/20238535DatabricksAdded
  • Add new property "AllowPreparedStatement" to prepare a query statement before its execution.
05/11/20238531SSISRemoved
  • Removed support for SQL Server Integration Services 2012 and Visual Studio 2012/2013.
04/25/20238515GeneralRemoved
  • Removed support for the SELECT INTO CSV statement. The core code doesn't support it anymore.
03/31/20238490DatabricksChanged
  • Support new AuthScheme "AzureAD".
03/15/20238474DatabricksAdded
  • Add new property "PersonalAccessTokenExpiresIn" to specifies the lifetime in seconds of the Databricks personal access token.
02/01/20238432DatabricksAdded
  • Add new property "ConnectRetryWaitTime" to specifies the number of seconds to wait to retry a connection request.
12/14/20228383GeneralChanged
  • Added the Default column to the sys_procedureparameters table.
12/05/20228374SSISAdded
  • Added support for SQL Server Integration Services 2022 and Visual Studio 2022
11/11/20228350DatabricksAdded
  • Added a new "UseLegacyDataModel" property. Set it to "true" to support the Unity Catalog. The default is "false", which does not change the previous behavior (the catalog is always "CData").
09/30/20228308GeneralChanged
  • Added the IsPath column to the sys_procedureparameters table.
08/18/20228265SSISChanged
  • Changed Azure module to Az module.
08/12/20228259DatabricksAdded
  • Added the connection property UseUploadApi to specify whether the Databricks Upload API will be used when executing Bulk Insert operations.
  • Added the connection property DeleteDataOnDrop to specify whether to completely delete the data and schema information of the delta table.
07/14/20228230DatabricksReplacements
  • Refactored metadata queries to improve the performance of GetTables and GetColumns.

Added
  • Added support for retrieving all schemas rather than just the default schema.
03/08/20228102DatabricksAdded
  • Added the connection property PrimaryKeyIdentifiers to specify primary keys.
  • Added support for Batch Update/Delete operations.
03/01/20228095DatabricksAdded
  • Added support for Delta Tables with the following ALTER features:
  • ALTER TABLE table_name
  • RENAME TO new_table_name
  • ADD [COLUMN | COLUMNS] (column_name column_type, ...)
  • ALTER COLUMN [SET | DROP] NOT NULL
  • RENAME COLUMN column_name TO new_column_name
02/08/20228074DatabricksAdded
  • Added the connection property ApplicationName to specify the HTTP header UserAgent.
02/07/20228073DatabricksAdded
  • Added the following Azure connection properties: AzureSubscriptionId, AzureResourceGroup and AzureWorkspace.

Removed
  • Removed the AuthScheme AzureAD.
  • Removed five AzureAD connection properties: AzureUsername, AzurePassword, AzureADTenantId, AzureADClientId and AzureADClientSecret.

Replacements
  • Use AzureServicePrincipal as the AuthScheme instead of AzureAd a replacement for AzureAD.
  • Added six AzureServicePrincipal connection properties as replacements: AzureTenantId, AzureClientId, AzureClientSecret.
01/14/20228049DatabricksAdded
  • Added support for the NATIVEQUERY table function. This function can be used after a FROM to execute a query using Databricks native SQL. For example, 
    SELECT * FROM NATIVEQUERY('SELECT * FROM default.tbl PIVOT (...)')
    will execute the inner query in Databricks directly and return the results. This will work even in tools which are not normally compatible with QueryPassthrough=true.
12/03/20218007DatabricksDeprecated
  • Connection properties UseShowDatabasesQuery, UseDescTableQuery, and UseShowTablesQuery are deprecated. They were not being used.
09/16/20217929DatabricksAdded
  • Added four connection properties SSLClientCert, SSLClientCertPassword, SSLClientCertSubject, SSLClientCertType.
09/02/20217915GeneralAdded
  • Added support for the STRING_SPLIT table-valued function in the CROSS APPLY clause.
08/07/20217889GeneralChanged
  • Added the KeySeq column to the sys_foreignkeys table.
08/06/20217888GeneralChanged
  • Added the new sys_primarykeys system table.
07/23/20217874GeneralChanged
  • Updated the Literal Function Names for relative date/datetime functions. Previously, relative date/datetime functions resolved to a different value when used in the projection as opposed to the predicate. For example: SELECT LAST_MONTH() AS lm, Col FROM Table WHERE Col > LAST_MONTH(). Formerly, the two LAST_MONTH() methods would resolve to different datetimes. Now, they will match.
  • As a replacement for the previous behavior, the relative date/datetime functions in the criteria may have an 'L' appended to them. For example: WHERE col > L_LAST_MONTH(). This will continue to resolve to the same values that were previously calculated in the criteria. Note that the "L_" prefix will only work in the predicate - it not available for the projection.
07/22/20217873SSISAdded
  • Added a UI type editor for the SQLStatement property of the SQLExecutor component.
07/08/20217859GeneralAdded
  • Added the TCP Logging Module for the logging information happening on the TCP wire protocol. The transport bytes that are incoming and ongoing will be logged at verbosity=5.
05/26/20217816SSISAdded
  • Added support for semicolon-separated SQL queries.
04/25/20217785GeneralAdded
  • Added support for handling client side formulas during insert / update. For example: UPDATE Table SET Col1 = CONCAT(Col1, " - ", Col2) WHERE Col2 LIKE 'A%'
04/23/20217783GeneralChanged
  • Updated how display sizes are determined for varchar primary key and foreign key columns so they will match the reported length of the column.
04/16/20217776GeneralAdded
  • Non-conditional updates between two columns is now available to all drivers. For example: UPDATE Table SET Col1=Col2
04/16/20217776GeneralChanged
  • Reduced the length to 255 for varchar primary key and foreign key columns.

Changed
  • Updated index naming convention to avoid duplicates.
04/16/20217776SSISAdded
  • Added a create table button for the Destination Component to make it easier to add a new destination in SSIS.
  • Improved user experience for Source Component by allowing users to select columns via a new checkbox dialog.

Changed
  • Improved query dialog for building parameterized statements.

Copyright (c) 2024 CData Software, Inc. - All rights reserved.
Build 24.0.9062