Append rows in a .csv file.

Question

Hello!

I have a workflow that creates a .csv file.

Every time I run the workflow, I would like the output tool not to overwrite the rows but to add them to an already existing .csv file

I notice that I can only do this in a DB or Excel output, but I don't have a DB at the moment and I have over 2 million records (Excel only reads 1.1 million records).

What can I do?

Thank's to everyone!

kamal03 · Answer

Hi @sebenciven

To handle large data in Alteryx beyond Excel's limits, install a local SQL Server (it's free). Create a table in it to store all your data. Configure Alteryx to keep adding new data to this table. This way, you can easily manage and process large datasets using SQL within Alteryx.

Let me know if your requirement is something different.

danilang · Answer

Hi @sebenciven

Even if the Input Tool did allow you to append, the last modified timestamp would still change.  By comparing the last modified with the created date you can show that the file was changed but there's no way see what changed.

If you're familiar with python, you can pass the new data to a python tool, open the file with the "a" access modifier which will allow you to append to the existing file.

Dan

sebenciven · Answer

@danilang thanks, but I would like to keep the table historicization and not overwrite the file in any way.
Is this possible in your opinion?