CData Python Connector for Elasticsearch

Build 24.0.9060

UPDATE SELECT Statements

To perform multiple updates in a single request to Elasticsearch,first use the INSERT INTO syntax to insert a temporary table of data into Elasticsearch. This works by first populating a temporary table with the data you are going to submit to Elasticsearch. Once you have all of the data you want to update, use UPDATE SELECT FROM to pass the temporary table data into the table in Elasticsearch.

Populate the Temporary Table

The temporary table you are populating is dynamic and is created at run time the first time you insert to it. Temporary tables are denoted by a # appearing in their name. When using a temporary table to update, the temporary table must be named in the format [TableName]#TEMP, where TableName is the name of the table you are inserting to. For example:

INSERT INTO [CData].[Elasticsearch].Employee#TEMP (Id, Name, MyCustomField__c) VALUES ('AX1000001', 'New Employee', '9000');
INSERT INTO [CData].[Elasticsearch].Employee#TEMP (Id, Name, MyCustomField__c) VALUES ('AX1000002', 'New Employee 2', '9001');
INSERT INTO [CData].[Elasticsearch].Employee#TEMP (Id, Name, MyCustomField__c) VALUES ('AX1000003', 'New Employee 3', '9002');

This creates a temporary table called [CData].[Elasticsearch].Employee#TEMP with three columns and three rows of data. Since type cannot be determined on the temporary table itself, all values are stored in memory as strings. The values are later converted to the proper type when they are submitted to the [CData].[Elasticsearch].Employee table.

Update the Actual Table

Once your temporary table is populated, it is now time to update the actual table in Elasticsearch. You can do this by performing an UPDATE to the actual table and selecting the input data from the temporary table. For example:

UPDATE [CData].[Elasticsearch].Employee (Id, Name, MyCustomField__c) SELECT Id, Name, MyCustomField__c FROM [CData].[Elasticsearch].Employee#TEMP
In this example, the full contents of the [CData].[Elasticsearch].Employee#TEMP table are passed into the [CData].[Elasticsearch].Employee table. This results in fewer requests being submitted to Elasticsearch since multiple updates may be submitted with each request, which is much better for performance if you have many records to update.

Results

The results of the query are stored in the LastResultInfo#TEMP temporary table. This table is cleared and repopulated the next time data is modified by passing in a temporary table. Please be aware that the LastResultInfo#TEMP table has no predefined schema. You need to check its metadata at run time before reading data.

Temporary Table Life Span

Temporary tables only last as long as the connection remains open. When the connection to Elasticsearch is closed, all temporary tables are cleared, including the LastResultInfo#TEMP table.

Copyright (c) 2024 CData Software, Inc. - All rights reserved.
Build 24.0.9060