Key Features

Added

• Updated the Sync UI for the Q2 rebrand.
• Added parallel partitioned reads. Parallel partitioned reads are supported in standard and CDC jobs. When parallel partition reads are enabled, they can greatly reduce job times by splitting a single replication into multiple partitions that can be processed in parallel by multiple threads. Parallel partitioned reads are currently supported when you use the following source database connections:
  • DB2
  • DB2 for i
  • Informix
  • MariaDB
  • Microsoft SQL Server
  • MySQL
  • Oracle
  • PostgreSQL
• Added ClickHouse as a Sync destination.
• Added support for GIT versioning in Sync workspaces.
  • Git Version Control
  • Git Version Control for Workspaces
• Added the Workspace Activities page.
• Added support for encrypting and decrypting sensitive values in the sync.properties file.
• Added support for Python Scripting in Sync events.
  • Python
  • Prerequisites
  • Writing Python
• Added support for including environment variable columns through source replication queries. Previously, you could only achieve this through column mapping.
• Added support for retrieving the relative record number (RRN) for DB2 for i CDC. This ability enables users to set SyncIdSourceColumn=Db2Rrn, which uses the RRN as the _cdatasync_id value instead of the default MD5-based row hash for tables without a primary key.
• Added support for including the ROWID pseudocolumn during Oracle CDC replications. When no primary key is present, Sync uses ROWID as the row identifier during CDC operations. You can also alias this column as desired within replication queries.
• Added logic to skip events that are already retrieved by snapshots during the first incremental load of a job.
• Added support for LocalDateTime when you use replication functions like REPLICATE_LASTMODTIME() or REPLICATE_NEXTINTERVAL().
• Added support for UseLocalDateTime in Oracle CDC, PostgreSQL CDC, and ServiceNow sources.
• Added more items to job event input for improved monitoring capabilities in pipelines.
• Added support for configuring email alert content. Notification emails can now be configured to report easily readable table names. By setting globalemailtablesonly=true in the Other Settings field (System Settings > Advanced > Additional Settings > Other Settings) , Sync notification emails report the source and destination table columns, job status, and runtime. The default behavior using globalemailtablesonly=false continues to report whole job queries, job status, and runtime.
• Added support to display the OPERATION type for records in the Rows Failed summary for reverse ETL jobs. The Rows Failed summary now includes the record identifier (Id), details of the failure, and the operation performed on each failed record. Operation types include the following:
  • INSERT
  • UPSERT
  • UPDATE
  • DELETE
• Added support to the retry mechanism for failed DELETE operations in reverse ETL jobs.
• Added support for the History Mode property in SAP HANA destinations.
• Added a new flow to the Sync UI for migrating application databases. This guided flow can be accessed from the Migration tab in System Settings.
• Added support for resetting the CDC Engine in the Sync UI.
• Added support for configuring proxy and firewall settings for connections in the Sync UI.
• Added a new Re-sync Tasks option for easier job and task reruns.
• Added support for editing RSD files from the Sync UI when you use the API connector.
• Added support for creating Global/Private temporary tables during replications into Oracle. This feature saves the Oracle redo log size because Global/Private tables do not log information in redo logs.

Changed

• Improved performance while retrieving source table structures in Oracle CDC jobs.
• Improved handling NUMBER data types for Oracle Native CDC operations. You can now enable DowncastNumbers and set values for DefaultPrecision and DefaultScale for native Oracle connections in the Other Options field on the Advanced tab.
  • DowncastNumbers converts NUMBER types with 0 scale to INTEGER types whenever possible.
  • DefaultPrecision and DefaultScale set the precision and scale for NUMBER types that are returned with a NULL precision or scale.
• Improved the MERGE command for better PostgreSQL performance. Merge operations into PostgreSQL now use the more efficient INSERT...ON CONFLICT UPDATE query.
• Improved job performance for Load Folder jobs that use Microsoft OneLake sources.
• Improved column mapping selection for reverse ETL jobs in the UI.
• Updated the default application database to H2 following Derby deprecation. Current installations continue to maintain the existing Derby database.
• Updated application-database verification results to automatically append UseConnectionPooling=true to the connection string for application-database driver connections.
• Changed default behavior to create a new AES key for new Sync users.
• Changed error handling for enhanced CDC jobs that are run without having a stage file. This error is now generated by the CDC Engine and then handled on the application side, surfaced as a toast message.
• Separated CDC Engine and base job settings options. CDC Engine settings are now contained in their own dialog box.
• Updated the Incremental Replication widget to Snapshot Settings.
• Updating log verbosity in CDC jobs is now dynamic and no longer restarts the CDC Engine.
• Updated connection states for better usability. Connection states now also include Incomplete, Not Authorized, and Untested.
• Hid empty schemas in Add Task search results.
• Enhanced the Admin API for querying job and task status; multiple updates and refinements to API V2.

Fixed

• Fixed multiple issues in the Sync UI:
  • Fixed an issue in the UI where opening the Edit Schedule dialog box after scheduling a pipeline to run every minute incorrectly displayed the schedule as every 15 minutes.
  • Fixed an issue where the Task page of a Load Folder job flickered in the UI during job execution.
  • Fixed an issue in the UI where the checkbox for list items on the Select Repeat Elements tab was misaligned for the API connector.
  • Fixed an issue where the hierarchy of connection properties did not update in the UI when switching between driver versions.
• Fixed multiple issues on the Pipelines page:
  • Fixed an issue where the toast message that is displayed when you create a workspace from the Pipelines page was inconsistent with other workspace creation messages.
  • Fixed an issue where the YOUR WORKSPACES navigation drop-down menu was not displayed correctly when it was accessed from the Pipelines page.
  • Fixed an issue where searching for a specific job while adding an existing job to a pipeline returned no results, despite the job appearing on the compatible jobs list.
  • Fixed an issue where searching for a pipeline by using the name of the destination connector was not possible on the Pipelines page.
• Fixed an issue where navigating to the Dashboard page while multiple jobs were running concurrently could result in a Failed to get the count of query results error.
• Fixed an issue where job runtimes were incorrectly displayed on the Job History tab.
• Fixed an issue where two-factor authentication security codes could be set with any value. The field has been restricted to accept only digit values.