The CData ADO.NET Provider for Apache Hive enables you to take advantage of the bulk load support in Apache Hive through ApacheHiveDataAdapters. You can use the Batch API to execute related SQL data manipulation statements simultaneously. The provider translates all SQL queries in the batch into a single request.

Using the ADO.NET Batch API

Performing a batch update consists of the following basic steps:

1. Define custom parameterized SQL statements in ApacheHiveCommand objects.
2. Set the UpdatedRowSource property of the ApacheHiveCommand object to "UpdateRowSource.None".
3. Assign the ApacheHiveCommand objects to the ApacheHiveDataAdapter.
4. Add the parameters to the command.
5. Call the ApacheHiveDataAdapter's Update method. Pass in a DataSet or DataTable containing your changes.

Controlling Batch Size

Depending on factors such as the size of the request, your network resources, and the performance of the server, you may gain performance by executing several smaller batch requests. You can control the size of each batch by setting the ApacheHiveDataAdapter's UpdateBatchSize property to a positive integer.

Bulk INSERT

The following code prepares a single batch that inserts records in bulk. The example executes a batch INSERT of new DataRows, which have the "Added" state.

C#

ApacheHiveDataAdapter adapter = new ApacheHiveDataAdapter();

using (ApacheHiveConnection conn = new ApacheHiveConnection("Server=127.0.0.1;Port=10000;TransportMode=BINARY")) {
  conn.Open();
  adapter.InsertCommand = conn.CreateCommand();
  adapter.InsertCommand.CommandText = "INSERT INTO [CData].[Default].Customers (CompanyName) VALUES (@CompanyName)";
  adapter.InsertCommand.UpdatedRowSource = UpdateRowSource.None;
  adapter.InsertCommand.Parameters.Add("@CompanyName", "CompanyName");

  DataTable batchDataTable = new DataTable();
  batchDataTable.Columns.Add("CompanyName", typeof(string));
  batchDataTable.Rows.Add("John Deere");
  batchDataTable.Rows.Add("RSSBus Inc.");
  adapter.UpdateBatchSize = 2;
  adapter.Update(batchDataTable);
}

VB.NET

 
Dim adapter As New ApacheHiveDataAdapter()

Using conn As New ApacheHiveConnection("Server=127.0.0.1;Port=10000;TransportMode=BINARY")
  conn.Open()
  adapter.InsertCommand = conn.CreateCommand()
  adapter.InsertCommand.CommandText = "INSERT INTO [CData].[Default].Customers (City) VALUES (@CompanyName)"
  adapter.InsertCommand.UpdatedRowSource = UpdateRowSource.None
  adapter.InsertCommand.Parameters.Add("@CompanyName", "CompanyName")

  Dim batchDataTable As New DataTable()
  batchDataTable.Columns.Add("CompanyName", GetType(String))
  batchDataTable.Rows.Add("RSSBus Inc.")
  batchDataTable.Rows.Add("John Deere")
  adapter.UpdateBatchSize = 2
  adapter.Update(batchDataTable)
End Using

Bulk Delete

The following code prepares a single batch that deletes records in bulk. The primary key for each row is required. The following example executes a batch for all DataRow records with a "Deleted" state:

C#

ApacheHiveDataAdapter adapter = new ApacheHiveDataAdapter();

using (ApacheHiveConnection conn = new ApacheHiveConnection("Server=127.0.0.1;Port=10000;TransportMode=BINARY")) {
  conn.Open();
  adapter.DeleteCommand = conn.CreateCommand();
  adapter.DeleteCommand.CommandText = "DELETE FROM [CData].[Default].Customers WHERE _id=@_id";
  adapter.DeleteCommand.Parameters.Add("@_id", "_id");
  adapter.DeleteCommand.UpdatedRowSource = UpdateRowSource.None; 
  adapter.UpdateBatchSize = 2;
  adpater.Update(table);
}

VB.NET

Dim adapter As New ApacheHiveDataAdapter()

Using conn As New ApacheHiveConnection("Server=127.0.0.1;Port=10000;TransportMode=BINARY")
  conn.Open()
  adapter.DeleteCommand = conn.CreateCommand()
  adapter.DeleteCommand.CommandText = "DELETE FROM [CData].[Default].Customers WHERE _id=@_id"
  adapter.DeleteCommand.Parameters.Add("@_id", "_id")
  adapter.DeleteCommand.UpdatedRowSource = UpdateRowSource.None 
  adapter.UpdateBatchSize = 2
  adpater.Update(table)
End Using