This site uses different types of cookies, including analytics and functional cookies (its own and from other sites). To change your cookie settings or find out more, click here. If you continue browsing our website, you accept these cookies.
Debating whether or not to upgrade to the latest version of Alteryx Designer?
Is it possible to add support for XLSX and SAS format files present in S3 when using S3 Download Tool?
Also why is there a limitation on the type of files compared when we use S3 download tool compared to the big list available in input tool?
As S3 use grows, we may be able to add new formats.
The reason for the way we support files in S3 is that we believe streaming records is important when using large data sets. We have to implement that specifically and it does not work with all file types. This way, when we read a csv (or YXDB) file, we can start processing data as soon as we have a single record from the S3 data set. With some other formats we might have to download a very large file before we can open and start processing the data.
Thanks very much Ben for sharing the technical reasob for loading from S3. I totally understand the driver behind your deicision to make everything streaming in S3 so that there is no risk of degrated response from the interface.
However for smaller size files, the trade-off is not so evident.
IMHO ideally we can have a checkbox for streaming, checked by default and maybe in a specific advanced tab or simiar, so if we uncheck it we will have all the file types available as for normal input tool loaded in one go.
Agreed. I think its an important limitation to overcome as we are storing all sorts of files in s3 due to price/performance and its great to be able to retrieve them
Duplicate of https://community.alteryx.com/t5/Alteryx-Designer-Ideas/Amazon-S3-Download-Tool-should-support-non-C.... Please follow this linked thread for updates!
You must be a registered user to add a comment. If you've already registered, sign in. Otherwise, register and sign in.