Devart Snowflake Destination

Devart Snowflake Destination component loads data into Snowflake tables.

It can load data into Snowflake in two ways: either using normal DML SQL statements (slow) or write data to CSV files, upload them to a file storage service, and then command Snowflake to import these files (fast). In order to load data via CSV files, you need to select the BulkFileStorage to upload files too and specify parameters to connect to the selected storage. These parameters can be set on the Component Properties tab of the Advanced Editor for Devart Snowflake Destination. Devart Snowflake Destination supports Amazon S3 and Azure Blob Storage for such data loading.

It has the following custom properties:

Property

Description

Action

A DML operation to apply to the target object. Default value is BulkInsert. The following values are supported:

•Insert - This is the most common operation.
•Update - Devart Snowflake Destination component in the Update mode enables updating data in a data source. Peculiarity of this action consists in the fact, that performing it requires using primary key values of the target table (the Id value for cloud sources). Thus, when performing an update, you must know and specify the primary key values of the target table to update a record.
•Delete - Devart Snowflake Destination component in the Delete mode enables deleting data from a data source. As well as for the update operation, you must know and specify the primary key values of the target table to delete a record.

AWSAccessKeyID

The first part of Amazon Web Services access key. Used for connecting to Amazon S3 storage.

AWSSecretKey

The second part of your Amazon Web Services access key. Read more about AWS access keys here. Used for connecting to Amazon S3 storage.

AWSSecurityToken

An alternative option to AWS Access Key ID and AWS Secret Key pair. The Amazon Web Services security token is a temporary limited-privilege credential. Used for connecting to Amazon S3 storage.

AzureStorageAccount

Azure storage account name.

AzureStorageAccountKey

512-bit storage access key.

AzureStorageEndpointsProtocol

This parameter determines the protocol to use (HTTPS or HTTP). You may optionally change the protocol to use from default https to http, but this is not recommended.

BatchSize

The size of data uploaded to a storage service before actually starting import. Default value is 314572800 (300 Mb), which is 10 times the default  max size of an uploaded CSV file.

BulkFileStorage

The storage service to use for uploading temporary CSV files with data in order to import them to Snowflake. If this property is set to None, Devart Snowflake Destination loads data via usual DML statements, which can be slow. Can be None, AmazonS3, or Azure. The latter option means - to use Azure Blob Storage.

ObjectName

The name of a Snowflake table to load data into.

S3BucketName

The name of an Amazon S3 bucket to use for temporary CSV files. Used for connecting to Amazon S3 storage.

S3BucketRegion

AWS region, where your S3 storage is hosted.