All,
I've run into an issue that I would like to solve in a more automated way with Alteryx but can't seem to make any progress with other partial solves that have been posted. I need to import many large sets of data from a shared drive source and consolidate the information into a single dataset (eventually using Calgary b/c of the size). Some of these ASCII files are not compressed and can easily be handled in a batch macro with the file layout properly converting the fields, not the case with some of the larger files that are compressed with 7-Zip.
The now native support in Alteryx for GZ files does not support ASCII file layouts and efforts to then properly parse it if I just dump all the records to a single column CSV aren't working/practical. I thought I'd cracked it using CREW's Dynamic Formula Macro to then split out SUBSTRING columns for each of the data elements but it won't handle it for some reason, the records are always skewed incorrectly. (I've quadruple checked it and compared 1-1 with a normal formula but gotten different results)
I've found a number of different posts and macros that attempt parts of this action but cannot seem to get them to work (including https://github.com/bobpeers/Alteryx_SDK_Zip which no longer seems to function without a clear reason). Has anyone faced this same challenge and found a solution? This dataset is very sensitive so I cannot share any sample materials, hopefully this description is sufficient. Please let me know if you have any ideas/can help!
