CData Python Connector for Google BigQuery

Build 23.0.8839

WaitForBatchResults

Whether to wait for the job to complete when using the bulk upload API. Only active when InsertMode is set to Upload.

Data Type

bool

Default Value

true

Remarks

This property determines whether the connector will wait for batch jobs to report their status. By default property is true and INSERT queries will complete only once Google BigQuery has finished executed them. When this property is false the INSERT query will complete as soon as a job is submitted for it.

The default mode is recommended for reliability:

  1. INSERTs will never fail silently. If the connector does not wait for the job to finish, it will never receive an error if the job failed to execute.
  2. If the INSERT batch size is small enough, the connector may submit jobs quickly enough that it hits Google BigQuery's load job limits. This does not happen when waiting for batch results because the connector will not allow more than one job to execute at the same time on the same connection.

You can disable this option to achieve lower delays when inserting, but you must also make sure to obey the Google BigQuery rate limits and check the status of each job to track their status and determine whether they have succeeded or failed.

Copyright (c) 2024 CData Software, Inc. - All rights reserved.
Build 23.0.8839