"update:insert if new" option for Amazon Redshift Bulk Loader and Write in DB tool

[RyanNewsome]

There is "update:insert if new" option for the output data tool if using an ODBC connection to write to Redshift.

This option really needs to be added to the "amazon redshift bulk loader" method of the output data tool, and the write in db tool.

Without it means you are forced to use the "Delete and append" output which is a pain because then you need to keep reinserting data that you already have, slowing down the process.

Using the ODBC connection option of the output data tool to write to Redshift is not an option as it is too slow. Trying to write 200MB of data, the workflow runs for 20 minutes without any data reaching the destination table. End up just stopping the workflow.

[FredericP]

That and a SQL UPDATE feature too...

[ARich]

Hi All,

Thanks for the feedback- please continue to star if you have a need for this functionality.

Best,

Alex

[SamDrury]

Is this already be possible in some way, I ask because it sounds like someone has achieved it already, but I don't know how: https://community.alteryx.com/t5/Data-Sources/Amazon-Redshift-Bulk-Loader-Update-Insert-if-new/td-p/...

[reyes258]

This would be a great feature

[eman]

This indeed would be a great feature - absolutely needed.