Hyper file size

Question

Hey,

I have a wierd problem. I am using an output to a hyper file format. The file size is always a suprise. My workflow uses alteryx database an inputs and I am doing about three joins and removing blanks and null rows . The output is around 20 m rows and the file size is 1.3 gb. A day back with th same rows I had 3 more columns and the file size was 1.1 gb. I had a similar file size for a data with 145 m records and now at less than 20 percent of the data i still have a higher file size.

Can someone help me to help optimize the hyper fle size. Or an other suggestions.  The output goes to feed a tableau data source.

Thanks

SouravKayal · Answer

can you share some more information onthisplease

messi007 · Answer

@SouravKayal,

My recommendation is to reduce the number of column (keep only the ones you need for visualization).

try to use the auto field in order to optimize the column size.

Hope this helps!

Regards

ArtApa · Answer

Hi @SouravKayal - Here is what Tableau says: https://help.tableau.com/current/api/hyper_api/en-us/docs/hyper_api_defrag.html

You may use Alteryx instead of Python to rewrite the file though... 🙂