The CData ADO.NET Provider for Parquet enables you to take advantage of the bulk load support in Parquet through ParquetDataAdapters. You can use the Batch API to execute related SQL data manipulation statements simultaneously. The provider translates all SQL queries in the batch into a single request.

Using the ADO.NET Batch API

Performing a batch update consists of the following basic steps:

1. Define custom parameterized SQL statements in ParquetCommand objects.
2. Set the UpdatedRowSource property of the ParquetCommand object to "UpdateRowSource.None".
3. Assign the ParquetCommand objects to the ParquetDataAdapter.
4. Add the parameters to the command.
5. Call the ParquetDataAdapter's Update method. Pass in a DataSet or DataTable containing your changes.

Controlling Batch Size

Depending on factors such as the size of the request, your network resources, and the performance of the server, you may gain performance by executing several smaller batch requests. You can control the size of each batch by setting the ParquetDataAdapter's UpdateBatchSize property to a positive integer.

Bulk INSERT

The following code prepares a single batch that inserts records in bulk. The example executes a batch INSERT of new DataRows, which have the "Added" state.

C#

ParquetDataAdapter adapter = new ParquetDataAdapter();

using (ParquetConnection conn = new ParquetConnection("URI=C:\folder\table.parquet;")) {
  conn.Open();
  adapter.InsertCommand = conn.CreateCommand();
  adapter.InsertCommand.CommandText = "INSERT INTO SampleTable_1 (Column1) VALUES (@Column1)";
  adapter.InsertCommand.UpdatedRowSource = UpdateRowSource.None;
  adapter.InsertCommand.Parameters.Add("@Column1", "Column1");

  DataTable batchDataTable = new DataTable();
  batchDataTable.Columns.Add("Column1", typeof(string));
  batchDataTable.Rows.Add("Jon Doe");
  batchDataTable.Rows.Add("John");
  adapter.UpdateBatchSize = 2;
  adapter.Update(batchDataTable);
}

VB.NET

 
Dim adapter As New ParquetDataAdapter()

Using conn As New ParquetConnection("URI=C:\folder\table.parquet;")
  conn.Open()
  adapter.InsertCommand = conn.CreateCommand()
  adapter.InsertCommand.CommandText = "INSERT INTO SampleTable_1 (Id) VALUES (@Column1)"
  adapter.InsertCommand.UpdatedRowSource = UpdateRowSource.None
  adapter.InsertCommand.Parameters.Add("@Column1", "Column1")

  Dim batchDataTable As New DataTable()
  batchDataTable.Columns.Add("Column1", GetType(String))
  batchDataTable.Rows.Add("John")
  batchDataTable.Rows.Add("Jon Doe")
  adapter.UpdateBatchSize = 2
  adapter.Update(batchDataTable)
End Using