Devart Redshift Destination component loads data into Redshift tables.
It has the following custom properties:
Property
|
Description
|
BatchSize
|
The size of data uploaded to Amazon S3 before actually starting import. Default value is 314572800 (300 Mb), which is 10 times the default max size of an uploaded CSV file.
|
Operation
|
A DML operation to apply to the target object. Default value is BulkInsert. The following values are supported:
| • | Insert - This is the most common operation. |
| • | Update - Devart Redshift Destination component in the Update mode enables updating data in a data source. Peculiarity of this action consists in the fact, that performing it requires using primary key values of the target table (the Id value for cloud sources). Thus, when performing an update, you must know and specify the primary key values of the target table to update a record. |
| • | Delete - Devart Redshift Destination component in the Delete mode enables deleting data from a data source. As well as for the update operation, you must know and specify the primary key values of the target table to delete a record. |
| • | BulkInsert - Devart Redshift Destination component loads data in the following way to achieve the highest performance: |
| o | First, it writes data to a CSV file, till the CSV file reaches the size, specified in the UploadBatchSize property. After this, it uploads the CSV file to Amazon S3 and writes data to a new CSV file. |
| o | After the total size of uploaded files reaches the limit, specified in the BatchSize property, Devart Redshift Destination tells Redshift to import data from these CSV files. After import, uploaded files are deleted. |
|
RetryCount
|
The number of times to retry loading the data in case if it fails. Default value is 5.
|
RetryInterval
|
The number of seconds before repeating an attempt to load data. Default value is 1.
|
TableName
|
The name of an Amazon Redshift table to load data into.
|
UploadBatchSize
|
The max size of data, placed to one CSV file before uploading this file to Amazon S3 and starting to write data to a new CSV file.
|