community
cancel
Showing results for 
Search instead for 
Did you mean: 

Alteryx Designer Ideas

Share your Designer product ideas - we're listening!
Upgrade Alteryx Designer in 10 Steps

Debating whether or not to upgrade to the latest version of Alteryx Designer?

LEARN MORE

s3 AWS Redshift upload connector

Given redshift prefers accepting many small files for bulk loading into redshift, it would be good to be able to have a max record limit within the s3 upload tool (similar to functionality for s3 download)

 

The other functionality that is useful for the s3 upload tool is ability to append file names based on datetimestamp_001, 002, 003 etc similar to current output tool

3 Comments
Founder
Founder
Good suggestion. That would be fairly straight forward to do as a batch macro if you wanted it sooner. Feel free to reach out to me if you wanted any help.
Alteryx Certified Partner
Alteryx Certified Partner

Hi Adrian - I'd be happy to share my existing S3 / Redshift macro upload and as Ned says we can adapt for lots of files.

 

Have you tried the new Amazon Redshift Buk upload in the Output Data tool in v10? Keen to hear experiences if so.

Alteryx Certified Partner
Alteryx Certified Partner

Hi Everyone,

 

Thanks for the offer to help Chris. Ned has kindly created a workflow which then calls a batch s3 macro. I have attached it so that others can benefit

 

workflow.PNG

The s3 macro is that it takes fileNum as a input counter and then replace the filename with the latest counter

 

Replace([Destination], "XXX", PadLeft([#1], 3, '0'))

 

 

s3 macro.PNG