Transformations take raw data from your source and clean, shape, and organize it into a form that best fits your needs as you proceed through your data pipeline. Transformations allow you decide how your data should be shaped, giving you only the data you need in the form you need.
CData Sync offers two types of transformations:
ETL (In-Flight) transformations: The data is extracted and then transformed in-flight (midstream) before delivery to the destination.
ELT (Post-Job) transformations: The entirety of the data is moved to the destination, and then the transformation takes place.
Both ELT and ETL involve the same three steps:
Extract: Raw data is extracted from the source system. In ETL transformations, the data is then moved to a staging area.
Transform: The data is cleaned and mapped.
Load: The data is copied into the target system.
While the steps remain essentially the same between the two processes (with some differences), the order in which those steps are performed differs.