Devart Azure Synapse Analytics Destination

Devart Azure Synapse Analytics Destination component loads data into Azure Synapse Analytics tables.

 

It has the following custom properties:

Property

Description

BatchSize

The size of data uploaded to Azure Blob Storage before actually starting import. Default value is 314572800 (300 Mb), which is 10 times the default  max size of an uploaded CSV file.

Operation

A DML operation to apply to the target object. Default value is BulkInsert. The following values are supported:

Insert - This is the most common operation.
Update - Devart Azure Synapse Analytics Destination component in the Update mode enables updating data in a data source. Peculiarity of this action consists in the fact, that performing it requires using primary key values of the target table (the Id value for cloud sources). Thus, when performing an update, you must know and specify the primary key values of the target table to update a record.
Delete - Devart Azure Synapse Analytics Destination component in the Delete mode enables deleting data from a data source. As well as for the update operation, you must know and specify the primary key values of the target table to delete a record.
BulkInsert - Devart Azure Synapse Analytics Destination component uses PolyBase to quickly load large volumes of data to Azure Synapse Analytics. It loads data in the following way:
oFirst, it writes data to a CSV file, till the CSV file reaches the size, specified in the UploadBatchSize property. After this, it uploads the CSV file to Azure Blob Storage and writes data to a new CSV file.
oAfter the total size of uploaded files reaches the limit, specified in the BatchSize property, Devart Azure Synapse Analytics Destination tells Azure Synapse Analytics to import data from these CSV files. After import, uploaded files are deleted.

RetryCount

The number of times to retry loading the data in case if it fails. Default value is 5.

RetryInterval

The number of seconds before repeating an attempt to load data. Default value is 1.

TableName

The name of an Azure Synapse Analytics table to load data into.

UploadBatchSize

The max size of data, placed to one CSV file before uploading this file to Azure Blob Storage and starting to write data to a new CSV file.