Amazon S3 multiple file impoort

I have Multiple objects in my AWS Path, and i need to import all of them to consolidate the data. I tried using Regular Expressions ( Such as * , etc) but its throwing the error, does anyone know how to resolve this issue OR is there any alternative ways to do it ?

AWS.png

Developer

Regex

Amazon S3

Download

Accepted answers

All comments

alexnajm

Have you tried using the AWS tools on the marketplace built by Aimpoint? https://marketplace.alteryx.com/en-US/apps/424306/aws-tools-by-aimpoint-digital

alexnajm

More here: https://aimpointdigital.com/alteryx-aws-tools/

kc20

I'm giving AWS tools by Aimpoint a shot and getting error "Amazon S3 Download (8) No module named 'boto3'"

apathetichell

@kc20 Boto3 is the Python AWS package. I am 99% sure that under the hood Aimpoint installs this package (or checks for it). If you are seeing that error - you probably cannot install it. Can you run Alteryx at admin. Open a Python tool -and type:

Alteryx.installPackage("boto3")

- check for errors. try to fix errors. re-run S3 workflow.

kc20

That did the trick, thank you!

kc20

@alexnajm any plan to include role base authentication for AWS tools?

apathetichell

@kc20 - I'd recommend doing this via Run command/CLI scripting.

kc20

any explain CLI script that anyone can share?

mmichaelson

@kc20 This article may have what you're looking for:

https://knowledge.alteryx.com/index/s/article/Extending-Integration-with-AWS-1583460914693

apathetichell

Dude - that article could have used a formula tool to create content for a parameterized shell/.bat file - and then have runcommand execute that. Instead it calls for a batch macro??? - Not how i'd implement it.

mmichaelson

@apathetichell - Agreed, it could be done without the use of a batch macro. I'm referencing this article simply because it provides an example of how to call the AWS CLI using the Run command. As the article states, the macro is optional.

FWIW, the batch macro would be a nice way to "package" the functionality of the AWS CLI for users who aren't familiar with or comfortable with command-line scripting.

@kc20 - Please let us know if the previously referenced article is helpful.

Quick Links

This months top contributors

atcodedog05 19458

Qiu 15866

binu_acs 15708

MarqueeCrew 13708

apathetichell 13703