Batch Split Connector

Version 22.0.8473


Batch Split Connector


In CData Arc, data travels through flows as Messages that consist of a body and metadata headers. For example, if one connector passes a file to another, the file is transmitted as a Message that contains the file in the body and metadata about the file and associated connectors as headers. Messages can be grouped together in Batch Groups, which allow multiple messages to travel together as a single unit. Some uses for Batch Groups include moving data between systems and processing multiple purchase orders at once. When a Message is part of a Batch Group, it is referred to as a Batch Message.

The Batch Split connector splits Batch Groups that arrive in the Send folder (the Input tab of the connector settings pane) into individual messages. When a Batch Group is split, the individual messages are passed down the flow through the Output tab, where they can be processed by other connectors as needed.

Note: The Batch Split connector can only accept Batch Groups as inputs. If the connector receives an individual message as an input, it throws an error message.

Configuring Batching Settings

Correlation Id Header

In the connector configuration pane, the Advanced Settings section contains the Correlation Id Header field. When the connector splits a Batch Group, it generates a value for the header based on the Batch Group MessageId, and then it assigns the same header and value to each individual message.

If a message already has a Correlation Id header and value, it does not receive the header and value that is assigned to the rest of the messages.

Automation

In the Automation tab of the connector configuration pane, the Automation Settings section contains a checkbox labelled Send. If selected, the connector automatically splits Batch Groups into messages as soon as they arrive in the Send folder (Input tab). Otherwise, if this option is cleared, you must manually instruct the connector to split Batch Groups.