Batch Processing
The CData ADO.NET Provider for Teradata enables you to take advantage of the bulk load support in Teradata through TeradataDataAdapters. You can use the Batch API to execute related SQL data manipulation statements simultaneously.
Using the ADO.NET Batch API
Performing a batch update consists of the following basic steps:
- Define custom parameterized SQL statements in TeradataCommand objects.
- Set the UpdatedRowSource property of the TeradataCommand object to "UpdateRowSource.None".
- Assign the TeradataCommand objects to the TeradataDataAdapter.
- Add the parameters to the command.
- Call the TeradataDataAdapter's Update method. Pass in a DataSet or DataTable containing your changes.
Controlling Batch Size
Depending on factors such as the size of the request, your network resources, and the performance of the server, you may gain performance by executing several smaller batch requests. You can control the size of each batch by setting the TeradataDataAdapter's UpdateBatchSize property to a positive integer.
Bulk INSERT
The following code prepares a single batch that inserts records in bulk and retrieves the new records' Ids. The example executes a batch INSERT of new DataRows, which have the "Added" state.
C#
TeradataDataAdapter adapter = new TeradataDataAdapter(); using (TeradataConnection conn = new TeradataConnection("User=Admin;Password=test123;Database=Northwind;DataSource=127.0.0.1")) { conn.Open(); adapter.InsertCommand = conn.CreateCommand(); adapter.InsertCommand.CommandText = "INSERT INTO \"CData\".\"dbo\".NorthwindProducts (ProductName) VALUES (@ProductName)"; adapter.InsertCommand.UpdatedRowSource = UpdateRowSource.None; adapter.InsertCommand.Parameters.Add("@ProductName", "ProductName"); DataTable batchDataTable = new DataTable(); batchDataTable.Columns.Add("ProductName", typeof(string)); batchDataTable.Rows.Add("Jon Doe"); batchDataTable.Rows.Add("Jane Doe"); adapter.UpdateBatchSize = 2; adapter.Update(batchDataTable); TeradataCommand cmd = new TeradataCommand("SELECT * FROM LastResultInfo#TEMP", conn); adapter = new TeradataDataAdapter(cmd); DataTable res = new DataTable(); adapter.Fill(res); foreach (DataRow row in res.Rows) foreach(DataColumn col in res.Columns) Console.Write("{0}: {1}", col.ColumnName, row[col]); }
VB.NET
Dim adapter As New TeradataDataAdapter()
Using conn As New TeradataConnection("User=Admin;Password=test123;Database=Northwind;DataSource=127.0.0.1")
conn.Open()
adapter.InsertCommand = conn.CreateCommand()
adapter.InsertCommand.CommandText = "INSERT INTO \"CData\".\"dbo\".NorthwindProducts (ProductId) VALUES (@ProductName)"
adapter.InsertCommand.UpdatedRowSource = UpdateRowSource.None
adapter.InsertCommand.Parameters.Add("@ProductName", "ProductName")
Dim batchDataTable As New DataTable()
batchDataTable.Columns.Add("ProductName", GetType(String))
batchDataTable.Rows.Add("Jane Doe")
batchDataTable.Rows.Add("Jon Doe")
adapter.UpdateBatchSize = 2
adapter.Update(batchDataTable)
Dim cmd As New TeradataCommand("SELECT * FROM LastResultInfo#TEMP", conn)
adapter = New TeradataDataAdapter(cmd)
Dim res As New DataTable()
adapter.Fill(res)
For Each row As DataRow In res.Rows
For Each col As DataColumn In res.Columns
Console.WriteLine("{0}: {1}", col.ColumnName, row(col))
Next
Next
End Using
Bulk Update
A batch update additionally requires the primary key of each row to update. The following example executes a batch for all DataRow records with a "Modified" state:
C#
TeradataDataAdapter adapter = new TeradataDataAdapter(); using (TeradataConnection conn = new TeradataConnection("User=Admin;Password=test123;Database=Northwind;DataSource=127.0.0.1")) { conn.Open(); adapter.UpdateCommand = conn.CreateCommand(); adapter.UpdateCommand.CommandText = "UPDATE \"CData\".\"dbo\".NorthwindProducts SET ProductName=@ProductName WHERE ProductId=@ProductId"; adapter.UpdateCommand.Parameters.Add("@ProductName", "ProductName"); adapter.UpdateCommand.Parameters.Add("@ProductId", "ProductId"); adapter.UpdateCommand.UpdatedRowSource = UpdateRowSource.None; DataTable batchDataTable = new DataTable(); batchDataTable.Columns.Add("ProductName", typeof(string)); batchDataTable.Rows.Add("Jon Doe"); batchDataTable.Rows.Add("Jane Doe"); adapter.UpdateBatchSize = 2; adapter.Update(dataTable); }
VB.NET
Dim adapter As New TeradataDataAdapter()
Using conn As New TeradataConnection("User=Admin;Password=test123;Database=Northwind;DataSource=127.0.0.1")
conn.Open()
adapter.UpdateCommand = conn.CreateCommand()
adapter.UpdateCommand.CommandText = "UPDATE \"CData\".\"dbo\".NorthwindProducts SET ProductName=@ProductName WHERE ProductId=@ProductId"
adapter.UpdateCommand.Parameters.Add("@ProductName", "ProductName")
adapter.UpdateCommand.Parameters.Add("@ProductId", "ProductId")
adapter.UpdateCommand.UpdatedRowSource = UpdateRowSource.None
Dim batchDataTable As New DataTable()
batchDataTable.Columns.Add("ProductName", GetType(String))
batchDataTable.Rows.Add("Jane Doe")
batchDataTable.Rows.Add("Jon Doe")
adapter.UpdateBatchSize = 2
adapter.Update(dataTable)
End Using
Bulk Delete
The following code prepares a single batch that deletes records in bulk. The primary key for each row is required. The following example executes a batch for all DataRow records with a "Deleted" state:
C#
TeradataDataAdapter adapter = new TeradataDataAdapter();
using (TeradataConnection conn = new TeradataConnection("User=Admin;Password=test123;Database=Northwind;DataSource=127.0.0.1")) {
conn.Open();
adapter.DeleteCommand = conn.CreateCommand();
adapter.DeleteCommand.CommandText = "DELETE FROM \"CData\".\"dbo\".NorthwindProducts WHERE ProductId=@ProductId";
adapter.DeleteCommand.Parameters.Add("@ProductId", "ProductId");
adapter.DeleteCommand.UpdatedRowSource = UpdateRowSource.None;
adapter.UpdateBatchSize = 2;
adpater.Update(table);
}
VB.NET
Dim adapter As New TeradataDataAdapter()
Using conn As New TeradataConnection("User=Admin;Password=test123;Database=Northwind;DataSource=127.0.0.1")
conn.Open()
adapter.DeleteCommand = conn.CreateCommand()
adapter.DeleteCommand.CommandText = "DELETE FROM \"CData\".\"dbo\".NorthwindProducts WHERE ProductId=@ProductId"
adapter.DeleteCommand.Parameters.Add("@ProductId", "ProductId")
adapter.DeleteCommand.UpdatedRowSource = UpdateRowSource.None
adapter.UpdateBatchSize = 2
adpater.Update(table)
End Using