Support for GZIP (.gz) compressed files in input tool, both in Designer and Server

[blyons]

Please support GZIP files in the input tool for both Designer and Server.

I get several large .gz files every day containing our streaming server logs. I need to parse and import these using Alteryx (we currently use Sawmill). Extracting each of these files would take a huge amount of space and time.

This was previously requested and marked as "now available", but what is available only addressed a small part of the request. First, that request was for both ZIP and GZIP. What is now available is only ZIP. Second, it requested both input and output, what is now available is input only. Third, while not explicitly stated in the request, it needs to function in Alteryx Server in order to be scheduled on a daily basis.

[denny]

Yes. Tar should be supported too.


Thanks,
Denny
213.486.1793 (91793)

[blyons]

Yes, definitely tar files too. Many of mine are both tarred & gzipped.

Sent from my Android phone using TouchDown (www.symantec.com)

[steven4320555]

Looking forward to using Alteryx to work with gz file, especially the OS mastermap topography layer.  It will be very cool to just get the necessary information from a bunch of gz files, without the need to load all the information to GIS softwares. With some advanced tools, it can still take tens of hours. eg. http://www.lutraconsulting.co.uk/blog/2015/02/23/loading-mastermap-free-easy-fast/  

[JordanHowell]

Large supply chain data for our company is also in gzip files on Amazon S3.  Need this supported.

[ianweinstock]

 pretty, pretty please with sugar on top

[hermanskym]

Any update on this? We would really use gzip support on input/output and S3

Thank you

[JordanHowell]

I haven't heard anything from Alteryx.  We're starting to move our source system files to Amazon S# via gzip format.  We need it as well. 

---

@blyons wrote:

Please support GZIP files in the input tool for both Designer and Server.

I get several large .gz files every day containing our streaming server logs. I need to parse and import these using Alteryx (we currently use Sawmill). Extracting each of these files would take a huge amount of space and time.

This was previously requested and marked as "now available", but what is available only addressed a small part of the request. First, that request was for both ZIP and GZIP. What is now available is only ZIP. Second, it requested both input and output, what is now available is input only. Third, while not explicitly stated in the request, it needs to function in Alteryx Server in order to be scheduled on a daily basis.

---

[AndyMoncla]

I talked with Need Harding about this at Inspire.  Unfortunately if I understood correctly, the GZIP format is not conducive/formatted well for direct import to Alteryx.  Basically, it would be so slow that it wouldn't be worth it.

However, I think we could make the case for sacrificing speed so that we could take advantage of the scheduler during less busy times.  It would also save us having to unzip the files and then delete the unzipped files.

If we move to a hosted server environment, would it be more cost effective to 1) run slower reading GZIP files directly or 2) having the gigantic, unzipped files on the server?

[blyons]

I find this very strange, since Sawmill (https://www.sawmill.net/) can do it just fine, and is blazing fast.

I'd prefer to use just one tool (Alteryx), but unless Alteryx begins supporting this, I guess I'll just have to stick with Sawmill for log parsing. :( 

[JordanHowell]

---

 I agree @andy_moncla.  

Our enterprise is saying that if Alteryx can't support the gzip files their uploading into S3, then we should look into using other tools as well...which stinks. 

---