Dealing with large output of data

Question

Hi!

Dear Alteryx experts,

I am struggling with choosing of proper file type to save about 11 millions rows of data.

Xls/xlsx/csv/mdb file types are not optimal for this amount of data (limit of rows there is about 1 million).

The output should be saved at one sheet/table.

Desired result - create an Pivot table, based at this dataset.

I also tried "json" data type and got about 40GB file, which seems to be hard to upload into Excel and create connection (too long to process the data and got an error while uploading it).

Ideally, I would like to upload this (output) file on G-drive and create connection with Excel workbook, located at SharePoint, where I could create Pivot table.

Maybe you have any solutions for this case?

Thank you!

Prometheus · Answer

@User12 I would think not, since it's an Alteryx file type. I missed that part of your original question.

User12 · Answer

No, I haven't

But I wonder if Power Query can read this file type? I can't see this one in list to import data into Query.

Prometheus · Answer

@User12 Have you tried saving to .yxdb? It will give you that kind of room to save millions of rows.