JDBC Driver for Google BigQuery

Build 21.0.8137

ύX

General Changes

[7915] - 2021-09-02

Added
  • Added support for the STRING_SPLIT table-valued function in the CROSS APPLY clause.

[7889] - 2021-08-07

Changed
  • Add the KeySeq column to the sys_foreignkeys table.

[7888] - 2021-08-06

Changed
  • Add the new sys_primarykeys system table.

[7874] - 2021-07-23

Changed
  • Updated the Literal Function Names for relative date/datetime functions. Previously relative date/datetime functions resolved to a different value when used in the projection vs te predicate. Ie: SELECT LAST_MONTH() AS lm, Col FROM Table WHERE Col > LAST_MONTH(). Formerly the two LAST_MONTH() methods would resolve to different datetimes. Now they will match.
  • As a replacement for the previous behavior, the relative date/datetime functions in the criteria may have an 'L' appended to them. Ie: WHERE col > L_LAST_MONTH(). This will continue to resolve to the same values that previously were calculated in the criteria. Note that the "L_" prefix will only work in the predicate - it not available for the projection.

[7859] - 2021-07-08

Added
  • Added the TCP Logging Module for the logging information happening on the TCP wire protocol. The transport bytes that are incoming and ongoing will be logged at verbosity=5.

[7785] - 2021-04-23

Added
  • Added support for handling client side formulas during insert / update. For example: UPDATE Table SET Col1 = Concat(Col1, " - ", Col2) WHERE Col2 LIKE 'A%'

[7783] - 2021-04-23

Changed
  • Updated how display sizes are determined for varchar primary key and foreign key columns so they will match the reported length of the column.

[7776] - 2021-04-16

Added
  • Non-conditional updates between two columns is now available to all drivers. For example: UPDATE Table SET Col1=Col2
Changed
  • Reduced the length to 255 for varchar primary key and foreign key columns.
  • Updated implicit and metadata caching to improve performance and support for multiple connections. Old metadata caches are not compatible - you would need to generate new metadata caches if you are currently using CacheMetadata.
  • Updated index naming convention to avoid duplicates
  • Updated and standardized Getting Started connection help.
  • Added the Advanced Features section to the help of all drivers.
  • Categorized connection property listings in the help for all editions.

JDBC Driver Changes

[8090] - 2022-02-24

Changed
  • Correct the return value of method DatabaseMetaData.supportsOuterJoins(), it used to return the wrong value.

[7970] - 2021-10-27

Changed
  • Support for JDK 17

[7925] - 2021-09-12

Removed
  • Removed IS_READONLY, IS_KEY, NUMERIC_PRECISION, DECIMAL_DIGITS from DatabaseMetadata.GetColumns() as they are not part of the JDBC Specification. This information is still available via other metadata calls.

Google BigQuery Changes

[8084] 2022-02-18

Added
  • Added support for ALTER TABLE. Due to BigQuery limitations, the only supported operations are ADD COLUMN, DROP COLUMN, ALTER COLUMN and (table) RENAME TO.

[8061] - 2022-01-26

Added
  • Added support for querying snapshot tables. Append it to the AllowedTableTypes connection property (along with other allowed table types) to make them show up.

[8048] 2022-01-13

Added
  • Added support for the NATIVEQUERY table function. This function can be used after a FROM to execute a query using BigQuery-native SQL. For example,
    SELECT * FROM NATIVEQUERY('SELECT * FROM UNNEST([1,2,3]) AS a')
    will execute the inner query in BigQuery directly and return the results. This will work even in tools which are not normally compatible with QueryPassthrough=true.

[8039] - 2022-01-04

Added
  • Added support for querying materialized views.

[8024] - 2021-12-20

Added
  • Added support for using the BigQuery TABLESAMPLE without enabling QueryPassthrough. If TableSamplePercent is set then the random row selection happens server-side for each table used in a query.

[8014] - 2021-12-10

Changed
  • Migrate to the latest version of the Storage API.

[7964] - 2021-10-21

Added
  • Added support for reading policy tags from the Data Catalog service. These are exposed using the PolicyTags column on sys_tablecolumns.

[7963] - 2021-10-20

Added
  • Added support for parameterized data types, both on the read side with and without UseStorageAPI as well as on the metadata side. The metadata is only reported on the table itself and not in queries, since BigQuery only enforces length/precision/scale when the data is written.

[7915] - 2021-09-02

Added
  • Added support for bulk UPDATE and DELETE operations. These make better use of BigQuery's DML query limits because each batch is just one MERGE operation. They are also faster because they use the bulk upload methods to send the list of rows to be changed. Primary keys must be defined on the tables to use DELETE.

[7891] - 2021-08-09

Added
  • Support for staging data in all formats allowed by BigQuery. JSON and Avro were already supported, this adds options that allow uploading data stored in the CSV, Parquet and ORC formats.

[7879] - 2021-07-28

Added
  • Added support for reading TIME, DATETIME and TIMESTAMP data at the full precision supported by BigQuery. We now report microsecond precision in .NET-based editions and millisecond precision in Java-based editions.

[7871] - 2021-07-20

Added
  • Added support for staging data with Google Cloud Storage when performing inserts. This is similar to the existing Upload insert mode, but transfers the row data into GCS and then creates a load job referencing it instead of performing the upload directly into BigQuery.

[7839] - 2021-06-18

Added
  • Added support for the GOOGLEJSONBLOB JWT certificate type. This works like the existing GOOGLEJSON certificate type except that the certificate is provided as JSON text instead of as a file path.

[7817] - 2021-05-27

Added
  • Added support for automatically reconnecting on Storage connections that have long idle times. This is useful most for ETL applications and other scenarios where the consumer reading data out of the driver is expected to be slower than the driver itself. In these cases the connection can be dropped by the other side (either by the Storage API itself or network appliances like firewalls and proxies) leading to timeouts. To avoid this the driver will restart the read from the same position using a new connection.

[7765] - 2021-04-05

Added
  • Added support for data unnesting. This mode performs client-side expansion of array data across multiple rows in a way that emulates the compact preview in the BigQuery UI. Server-side support of some options is limited in this mode (LIMIT and OFFSET) but otherwise behaves like the nested mode with the exception that it always outputs flat data and never outputs aggregates.
Changed
  • Updated the default value for WaitForBatchResults to true since not checking the job status at smaller batch sizes can lead to lost jobs.
Deprecated
  • Deprecated the UseStreamingInserts connection property in favor of InsertMode. The default for InsertMode is Streaming.

[7733] - 2021-03-04

Removed
  • Removed the TempTableDataset and TempTableExpirationTime connection properties. These properties have been defunct since we moved to using the BigQuery-managed query cache for large resultsets.

[7699] - 2021-01-29

Added
  • Added support for the BIGNUMERIC type, which is twice the size of the existing numeric type. JDBC supports this type at full precision while .NET requires using the connection property IgnoreTypes=decimal because the full precision of BIGNUMERIC (as with regular NUMERIC) is too high for System.Decimal.

[7678] - 2021-01-08

Added
  • Added support for using the upload API for batch inserts. This is an API that is slower than the streaming API for large volumes of data, but is free to use and doesn't have the same buffering delays that streaming does. It is also async by default although the option to wait on the batch is available via the new WaitForBatchResults connection property.

[7663] - 2020-12-23

Added
  • Added support for unnesting metadata with the Storage API.

[7660] - 2020-12-21

Added
  • Added support for unnesting metadata with the REST API. By enabling UnnestArrays, metadata for fields within REPEATED RECORD types is returned as separate columns instead of generating JSON aggregates. These values can be selected within queries but are currently treated as NULL.

[7646] - 2020-12-07

Added
  • Added support for injecting partition filters into queries that require them but do not have them, if the user enables the InsertPartitionFilterOption. This modifies queries against partitioned tables that require a partition filter so that they always contain a valid partition filter, which allows queries like simple SELECT * FROM t to work. Currently all partitions are selected by the generated filter.

Copyright (c) 2022 CData Software, Inc. - All rights reserved.
Build 21.0.8137