Alteryx Designer Desktop Discussions

Find answers, ask questions, and share expertise about Alteryx Designer Desktop and Intelligence Suite.
SOLVED

Dynamically updating Object Name in AWS S3 Upload Tool

kuoshihyang
7 - Meteor

Good morning, I have the following workflow:

 WorkFlowQuestion.jpg

 

 

 

 

What it does is make an initial connection to an SFTP folder that contains a bunch of files.  The tools following will then filter out dates from the file names and filter down to the latest file I need for a particular client.  The problem I have after this is storing it dynamically onto an AWS S3 bucket.  I want to be able to schedule the workflow without any human intervention to pull the latest file automatically daily.  However, after doing a lot of research I only see options where others have used a macro to get a filename from a Question for the Object section in the S3 tool.  What I’m hoping is to be able to pass in the dynamic name into the Object section of the S3 tool via one of the formula tools which is already in the workflow that dynamically saves the file.  Do you know of a way of doing this without having to use a macro that asks a question? 

 Action Update Value with a Formula.jpg

 

S3 Object Name Update.jpg

 

 

 

Thanks for your input.

6 REPLIES 6
DanM
Alteryx Community Team
Alteryx Community Team

@kuoshihyang,

 

 You will have to create a batch macro that uses a Control Parameter to update the Object. The Object name from your Formula tool would be fed into the Control Parameter which would then feed into the AWS tool and then output the data back into the workflow.

 

This post isn't quite what you are trying to do, but the setup of the macro is very similar

https://community.alteryx.com/t5/Alteryx-Knowledge-Base/CS-Macro-Dev-Reading-in-multiple-files-with-...

 

2018-09-20_11-18-20.png

kuoshihyang
7 - Meteor

Thanks Dan! that was what I was looking for and I got it to work.  

Chaks
6 - Meteoroid

 

 

bryanbumgardner
8 - Asteroid

I'm experiencing the same problem. What's happening for me is that I've got this loaded into a Gallery application. 

 

When I run it manually on the Gallery, the Action tool will work properly using the "Update Value with Formula" selection to add the timestamp.

 

However, when I schedule the workflow to run automatically, it bypasses the "Update Value with Formula" tool and just uploads with the object name, which if it runs over and over, will just upload and overwrite the same file with the placeholder object name I have in the S3 tool.

 

I will be experimenting with this today and will respond if I fix it. 

 

aehrenwo
11 - Bolide

I created this exact setup and it successfully created the file with the name that I want.

 

However, when I use the macro it is painfully slow --- just keeps running (even for a small amount of data)

 

When I use the connector directly without the macro it runs very fast.  Is there some setting in the macro that I need to adjust?  Again I have it set up exactly as you outlined above. 

kd_007
5 - Atom

I tried setting up the properties in the tools as mentioned, but it doesn't work. The S3 object getting created is with the same name that in the S3 upload tool. Can someone provide a working alteryx workflow? May be I am missing some important property.

Labels