Problem with opening AVRO file
- Subscribe to RSS Feed
- Mark Topic as New
- Mark Topic as Read
- Float this Topic for Current User
- Bookmark
- Subscribe
- Mute
- Printer Friendly Page
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Notify Moderator
Hi all, I'm trying to open a 36MB AVRO file in the Input Data tool but Alteryx would hang after that...it was not responding after 20-30 minutes and I had to terminate the Alteryx process. The Input Data tool was able to open a smaller sample file (60KB). I'm using Alteryx v 2022.3.1.486 Patch 3. Thanks for any advice in advance!
- Labels:
- Input
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Notify Moderator
Hi @JohnL248 ,
I don't have a 36 MB avro file to test but you may try a workaround, i.e. - convert the avro file to a csv format using a python script and read it normally in Alteryx:
https://community.alteryx.com/t5/Alteryx-Designer-Desktop-Discussions/How-to-read-avro-file-in-Alter...
Please note - csv dont have the same compression methods as avro file and the csv file will probably be larger (50-100 mb).
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Notify Moderator
thanks for your suggestion, @amadra ! I have a python script already to read the avro file. I'm hoping to do that in Alteryx to perform additional data analytics.
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Notify Moderator
Is this file on a local drive - if not - place it on a local drive and then retry.
next issue - turn off amp - let's see if there is another error which amp isn't allowing to be flagged.
finally - downgrade Alteryx.I just ran a 100,000,000 row multi-gb file in 2021.4.
update! just remembered that I had 2022.3 on my system from an earlier test. I'll see if I can get the same file to load in 2022.3. so without AMP it ran - but then had some issues when I went back to the input data tool I'd recommend downgrading to 2022.1 or 2021.4.
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Notify Moderator
@apathetichell , thank for your suggestion! The avro file is already on my local c: drive and AMP has been turned off. Alteryx is still frozen after almost one hour. Unfortunately I can't downgrade the Alteryx version since this is a company installation.
