S3 upload - dynamic update of object name
- Subscribe to RSS Feed
- Mark Topic as New
- Mark Topic as Read
- Float this Topic for Current User
- Bookmark
- Subscribe
- Mute
- Printer Friendly Page
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Notify Moderator
I have read few discussions on this but did not find an optimal way to update the object name when uploading to s3 bucket. Does anyone have an non-macro solution for this?
Solved! Go to Solution.
- Labels:
- Amazon S3
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Notify Moderator
The batch macro really is the way to go for this. It's a straightforward macro, and seems less complex to me than other solutions like sending arguments into the Python tool using boto3.
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Notify Moderator
Thanks Charlie,
Do you have an example/workflow showing the macro? Let me know.
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Notify Moderator
Do you have some example data you can share? I'd be happy to build an example macro to get you started.
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Notify Moderator
Charlie,
Flow is like SQL table data > Upload to S3 using S3 upload connector. I am using sample data like below for this example if you would like. Or any data would be fine. The only issue I am having is to update the object name in the S3 upload connector when I am running the workflow multiple times. As you know it would replace the file in S3 every time I run. Instead of that I would like to append a date to the Object name so that it will create a new file everytime I run instead of replacing the existing file.
NO NAME ROLE
1 aaaa developer
2 bbbb qa
3 cccc business
4 dddd ste
5 eeee tester
6 ffff po
7 gggg bsa
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Notify Moderator
I am also looking for a similar solution.. i want datetime to be appended and new file needs to created everytime in S3..tried all possible ways no luck..Any suggestions would help.
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Notify Moderator
Have a similar problem and any solution would be greatly appreciated.
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Notify Moderator
Hi @alt19790525 , sorry this took so long.
I've attached an example workflow that shows how a batch macro could be used to update the S3 Object name from your workflow. I've also added a Formula tool to append today's date to the Objects name as requested by @Rohit3.
Check it out and let me know what you think.
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Notify Moderator
Hi Charlie,
Thanks for below details..
I do not see formula that appends todays date to object while uploading to S3.
Can you please tell me where exactly this has been written in workflow.
Regards
Rohit
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Notify Moderator
Thanks Charlie it worked. Appreciate your help.
