community
cancel
Showing results for 
Search instead for 
Did you mean: 

Alteryx Designer Ideas

Share your Designer product ideas - we're listening!
Upgrade Alteryx Designer in 10 Steps

Debating whether or not to upgrade to the latest version of Alteryx Designer?

LEARN MORE
Alteryx Gallery is experiencing a problem in which system emails are not being sent out. As a result, if you are attempting to sign up for a new account, you may be unable to verify your email address. We are working to solve this as soon as possible and will remove this notice once resolved.

Support for GZIP (.gz) compressed files in input tool, both in Designer and Server

Please support GZIP files in the input tool for both Designer and Server.

 

I get several large .gz files every day containing our streaming server logs. I need to parse and import these using Alteryx (we currently use Sawmill). Extracting each of these files would take a huge amount of space and time.

 

This was previously requested and marked as "now available", but what is available only addressed a small part of the request. First, that request was for both ZIP and GZIP. What is now available is only ZIP. Second, it requested both input and output, what is now available is input only. Third, while not explicitly stated in the request, it needs to function in Alteryx Server in order to be scheduled on a daily basis.

 

47 Comments
Asteroid
Yes. Tar should be supported too.


Thanks,
Denny
213.486.1793 (91793)
Comet
Yes, definitely tar files too. Many of mine are both tarred & gzipped.

Sent from my Android phone using TouchDown (www.symantec.com)
Asteroid

Looking forward to using Alteryx to work with gz file, especially the OS mastermap topography layer.  It will be very cool to just get the necessary information from a bunch of gz files, without the need to load all the information to GIS softwares. With some advanced tools, it can still take tens of hours. eg. http://www.lutraconsulting.co.uk/blog/2015/02/23/loading-mastermap-free-easy-fast/  

Large supply chain data for our company is also in gzip files on Amazon S3.  Need this supported.

Meteoroid

 pretty, pretty please with sugar on top

Alteryx Certified Partner

Any update on this? We would really use gzip support on input/output and S3

Thank you

I haven't heard anything from Alteryx.  We're starting to move our source system files to Amazon S# via gzip format.  We need it as well. 


@blyons wrote:

Please support GZIP files in the input tool for both Designer and Server.

 

I get several large .gz files every day containing our streaming server logs. I need to parse and import these using Alteryx (we currently use Sawmill). Extracting each of these files would take a huge amount of space and time.

 

This was previously requested and marked as "now available", but what is available only addressed a small part of the request. First, that request was for both ZIP and GZIP. What is now available is only ZIP. Second, it requested both input and output, what is now available is input only. Third, while not explicitly stated in the request, it needs to function in Alteryx Server in order to be scheduled on a daily basis.

 


 

ACE Emeritus
ACE Emeritus

I talked with Need Harding about this at Inspire.  Unfortunately if I understood correctly, the GZIP format is not conducive/formatted well for direct import to Alteryx.  Basically, it would be so slow that it wouldn't be worth it.

 

However, I think we could make the case for sacrificing speed so that we could take advantage of the scheduler during less busy times.  It would also save us having to unzip the files and then delete the unzipped files.

 

If we move to a hosted server environment, would it be more cost effective to 1) run slower reading GZIP files directly or 2) having the gigantic, unzipped files on the server?

Comet

I find this very strange, since Sawmill (https://www.sawmill.net/) can do it just fine, and is blazing fast.

 

I'd prefer to use just one tool (Alteryx), but unless Alteryx begins supporting this, I guess I'll just have to stick with Sawmill for log parsing. 😞 


 I agree @andy_moncla.  

 

Our enterprise is saying that if Alteryx can't support the gzip files their uploading into S3, then we should look into using other tools as well...which stinks.