ADO.NET Provider for Snowflake

Build 24.0.9060

Batch Processing

The CData ADO.NET Provider for Snowflake enables you to take advantage of the bulk load support in Snowflake through SnowflakeDataAdapters. You can use the Batch API to execute related SQL data manipulation statements simultaneously.

Using the ADO.NET Batch API

Performing a batch update consists of the following basic steps:

  1. Define custom parameterized SQL statements in SnowflakeCommand objects.
  2. Set the UpdatedRowSource property of the SnowflakeCommand object to "UpdateRowSource.None".
  3. Assign the SnowflakeCommand objects to the SnowflakeDataAdapter.
  4. Add the parameters to the command.
  5. Call the SnowflakeDataAdapter's Update method. Pass in a DataSet or DataTable containing your changes.

Controlling Batch Size

Depending on factors such as the size of the request, your network resources, and the performance of the server, you may gain performance by executing several smaller batch requests. You can control the size of each batch by setting the SnowflakeDataAdapter's UpdateBatchSize property to a positive integer.

Bulk INSERT

The following code prepares a single batch that inserts records in bulk. The example executes a batch INSERT of new DataRows, which have the "Added" state.

C#

SnowflakeDataAdapter adapter = new SnowflakeDataAdapter();

using (SnowflakeConnection conn = new SnowflakeConnection("url=https://myaccount.region.snowflakecomputing.com;user=Admin;password=test123;Database=Northwind;Warehouse=TestWarehouse;Account=Tester1;")) {
  conn.Open();
  adapter.InsertCommand = conn.CreateCommand();
  adapter.InsertCommand.CommandText = "INSERT INTO [DemoDB].[PUBLIC].Products (ProductName) VALUES (@ProductName)";
  adapter.InsertCommand.UpdatedRowSource = UpdateRowSource.None;
  adapter.InsertCommand.Parameters.Add("@ProductName", "ProductName");

  DataTable batchDataTable = new DataTable();
  batchDataTable.Columns.Add("ProductName", typeof(string));
  batchDataTable.Rows.Add("Ikura");
  batchDataTable.Rows.Add("Konbu");
  adapter.UpdateBatchSize = 2;
  adapter.Update(batchDataTable);
}

VB.NET

 
Dim adapter As New SnowflakeDataAdapter()

Using conn As New SnowflakeConnection("url=https://myaccount.region.snowflakecomputing.com;user=Admin;password=test123;Database=Northwind;Warehouse=TestWarehouse;Account=Tester1;")
  conn.Open()
  adapter.InsertCommand = conn.CreateCommand()
  adapter.InsertCommand.CommandText = "INSERT INTO [DemoDB].[PUBLIC].Products (Id) VALUES (@ProductName)"
  adapter.InsertCommand.UpdatedRowSource = UpdateRowSource.None
  adapter.InsertCommand.Parameters.Add("@ProductName", "ProductName")

  Dim batchDataTable As New DataTable()
  batchDataTable.Columns.Add("ProductName", GetType(String))
  batchDataTable.Rows.Add("Konbu")
  batchDataTable.Rows.Add("Ikura")
  adapter.UpdateBatchSize = 2
  adapter.Update(batchDataTable)
End Using

Bulk Update

A batch update additionally requires the primary key of each row to update. The following example executes a batch for all DataRow records with a "Modified" state:

C#

SnowflakeDataAdapter adapter = new SnowflakeDataAdapter();

using (SnowflakeConnection conn = new SnowflakeConnection("url=https://myaccount.region.snowflakecomputing.com;user=Admin;password=test123;Database=Northwind;Warehouse=TestWarehouse;Account=Tester1;")) { 
  conn.Open();
  adapter.UpdateCommand = conn.CreateCommand();
  adapter.UpdateCommand.CommandText = "UPDATE [DemoDB].[PUBLIC].Products SET ProductName=@ProductName WHERE Id=@Id";
  adapter.UpdateCommand.Parameters.Add("@ProductName", "ProductName");
  adapter.UpdateCommand.Parameters.Add("@Id", "Id");
  adapter.UpdateCommand.UpdatedRowSource = UpdateRowSource.None; 
  DataTable batchDataTable = new DataTable();
  batchDataTable.Columns.Add("ProductName", typeof(string));
  batchDataTable.Rows.Add("Ikura");
  batchDataTable.Rows.Add("Konbu");
  adapter.UpdateBatchSize = 2;
  adapter.Update(dataTable);
}

VB.NET

 
Dim adapter As New SnowflakeDataAdapter()

Using conn As New SnowflakeConnection("url=https://myaccount.region.snowflakecomputing.com;user=Admin;password=test123;Database=Northwind;Warehouse=TestWarehouse;Account=Tester1;")
  conn.Open()
  adapter.UpdateCommand = conn.CreateCommand()
  adapter.UpdateCommand.CommandText = "UPDATE [DemoDB].[PUBLIC].Products SET ProductName=@ProductName WHERE Id=@Id"
  adapter.UpdateCommand.Parameters.Add("@ProductName", "ProductName")
  adapter.UpdateCommand.Parameters.Add("@Id", "Id")
  adapter.UpdateCommand.UpdatedRowSource = UpdateRowSource.None
  Dim batchDataTable As New DataTable()
  batchDataTable.Columns.Add("ProductName", GetType(String))
  batchDataTable.Rows.Add("Konbu")
  batchDataTable.Rows.Add("Ikura")
  adapter.UpdateBatchSize = 2
  adapter.Update(dataTable)
End Using

Bulk Delete

The following code prepares a single batch that deletes records in bulk. The primary key for each row is required. The following example executes a batch for all DataRow records with a "Deleted" state:

C#

SnowflakeDataAdapter adapter = new SnowflakeDataAdapter();

using (SnowflakeConnection conn = new SnowflakeConnection("url=https://myaccount.region.snowflakecomputing.com;user=Admin;password=test123;Database=Northwind;Warehouse=TestWarehouse;Account=Tester1;")) {
  conn.Open();
  adapter.DeleteCommand = conn.CreateCommand();
  adapter.DeleteCommand.CommandText = "DELETE FROM [DemoDB].[PUBLIC].Products WHERE Id=@Id";
  adapter.DeleteCommand.Parameters.Add("@Id", "Id");
  adapter.DeleteCommand.UpdatedRowSource = UpdateRowSource.None; 
  adapter.UpdateBatchSize = 2;
  adpater.Update(table);
}

VB.NET

Dim adapter As New SnowflakeDataAdapter()

Using conn As New SnowflakeConnection("url=https://myaccount.region.snowflakecomputing.com;user=Admin;password=test123;Database=Northwind;Warehouse=TestWarehouse;Account=Tester1;")
  conn.Open()
  adapter.DeleteCommand = conn.CreateCommand()
  adapter.DeleteCommand.CommandText = "DELETE FROM [DemoDB].[PUBLIC].Products WHERE Id=@Id"
  adapter.DeleteCommand.Parameters.Add("@Id", "Id")
  adapter.DeleteCommand.UpdatedRowSource = UpdateRowSource.None 
  adapter.UpdateBatchSize = 2
  adpater.Update(table)
End Using

Copyright (c) 2024 CData Software, Inc. - All rights reserved.
Build 24.0.9060