Hello,
I'm exeriencing compression error with a large dataset workflow and would appreciate and guidance.
I merged data from four folders, each containing an exel sheet, after merging the result file was approximately 4,5 GB in size with around
6.4 million rows.
The file successufully uploaded into alteryx designer and read without issues, I then performed,
a join operation with aother dataset containging profile information.
The problem
During testing i encounteed several error
Union 173, Data is corrupt after snnappy: Uncompress
Internal error, invalid type read appears to be a corrupt record.
Internal error, deadlock detected
Json build internal error, anchor was not closed
Any insight would be greatly appreciated!
.
Can you try to increase your memory setting in Alteryx and see if the issue still exists?
Alteryx builds an .yxdb file to temporarily store the data as it processes it. To check if the file is generating correctly, I would recommend create a new workflow and read those excel files, output them as .yxdb and see if individually you are able to read them.
If you can, next step, union these .yxdb together and see if that works. If all this works, then it is just memory issue that you are facing.
User | Count |
---|---|
107 | |
82 | |
70 | |
54 | |
40 |