Devart BigQuery Destination component loads data into Google BigQuery tables.
It has the following custom properties:
Property
|
Description
|
Action
|
A DML operation to apply to the target object. Default value is Insert. The following values are supported:
| • | Insert - This is the most common operation. |
| • | Update - Devart BigQuery Destination component in the Update mode enables updating data in a data source. Peculiarity of this action consists in the fact, that performing it requires using primary key values of the target table (the Id value for cloud sources). Thus, when performing an update, you must know and specify the primary key values of the target table to update a record. |
| • | Delete - Devart BigQuery Destination component in the Delete mode enables deleting data from a data source. As well as for the update operation, you must know and specify the primary key values of the target table to delete a record. |
| • | Upsert - not supported for BigQuery. |
| • | HardDelete - not supported for BigQuery. |
|
BatchSize
|
The max size of data uploaded to Google Cloud Storage before actually starting import. Default value is 314572800 (300 Mb), which is 10 times the default max size of an uploaded CSV file.
|
BulkInsert
|
This property is taken into account only when the Action property is set to Insert. When set to True, Devart BigQuery Destination component loads data in the following way to achieve the highest performance:
| • | First, it writes data to a CSV file, till the CSV file reaches the size, specified in the UploadBatchSize property. After this, it uploads the CSV file to Google Cloud Storage and writes data to a new CSV file. |
| • | After the total size of uploaded files reaches the limit, specified in the BatchSize property, Devart BigQuery Destination tells Google BigQuery to import data from these CSV files. After import, uploaded files are deleted. |
When this property is set to False, Devart BigQuery Destination uses usual INSERT statement to insert data.
|
TableName
|
The name of a Google BigQuery table to load data into.
|
UploadBatchSize
|
The max size of data, placed to one CSV file before uploading this file to Google Cloud Storage and starting to write data to a new CSV file.
|