Advent of Code is back! Unwrap daily challenges to sharpen your Alteryx skills and earn badges along the way! Learn more now.

Alteryx Designer Desktop Discussions

Find answers, ask questions, and share expertise about Alteryx Designer Desktop and Intelligence Suite.

Compression rate of a yxdb file

MartWClimber
9 - Comet

I've got a large yxdb file and not as many temp storage to work with. I want to know what the compression of an Alteryx file is so I can split new files accordingly to never hit the temp storage.

Is there an easy answer to the compression rate of an yxdb file

 

for example 

yxdb = 2gb than the flat file is approximately 6 gb so the compression rate then is 1/3

4 REPLIES 4
saveeshkumar
9 - Comet

Hi @MartWClimber 
The .yxdb format is the most efficient file type for reading and writing in Alteryx because it has no size limit, is compressed for maximum speed, and includes additional metadata that references the source of the data and how the data was created. While there is no limit to the number of records or file size, there is a record size limit of 2GB in a 64-bit environment. All Alteryx products have read and write support for .yxdb files.

Alteryx Database File Format

Thanks.

MartWClimber
9 - Comet

@saveeshkumar, yes, i found that too, but I want to know what the compression rate is. how dense/ what percentage of the original flat file will an yxdb file be. that is what i'm looking for. Is this 1/15th of the original flat file or 1/30, an other larger number? 

gabrielvilella
14 - Magnetar

Well, the best way is to test it yourself. 

saveeshkumar
9 - Comet

Hi @MartWClimber ,

 

Sample testing on csv file.

 

FileNameActual Size(GB)YXDB Size(GB)%
CSV5.72.442.11
CSV17.17.2242.22
CSV34.314.441.98
CSV45.719.2

42.01

 

Thanks

Labels