I've got a large yxdb file and not as many temp storage to work with. I want to know what the compression of an Alteryx file is so I can split new files accordingly to never hit the temp storage.
Is there an easy answer to the compression rate of an yxdb file
for example
yxdb = 2gb than the flat file is approximately 6 gb so the compression rate then is 1/3
Hi @MartWClimber
The .yxdb format is the most efficient file type for reading and writing in Alteryx because it has no size limit, is compressed for maximum speed, and includes additional metadata that references the source of the data and how the data was created. While there is no limit to the number of records or file size, there is a record size limit of 2GB in a 64-bit environment. All Alteryx products have read and write support for .yxdb files.
Alteryx Database File Format
Thanks.
@saveeshkumar, yes, i found that too, but I want to know what the compression rate is. how dense/ what percentage of the original flat file will an yxdb file be. that is what i'm looking for. Is this 1/15th of the original flat file or 1/30, an other larger number?
Well, the best way is to test it yourself.
Hi @MartWClimber ,
Sample testing on csv file.
FileName | Actual Size(GB) | YXDB Size(GB) | % |
CSV | 5.7 | 2.4 | 42.11 |
CSV | 17.1 | 7.22 | 42.22 |
CSV | 34.3 | 14.4 | 41.98 |
CSV | 45.7 | 19.2 | 42.01 |
Thanks