Append rows in a .csv file.

[sebenciven]

Hello!

I have a workflow that creates a .csv file.

Every time I run the workflow, I would like the output tool not to overwrite the rows but to add them to an already existing .csv file

I notice that I can only do this in a DB or Excel output, but I don't have a DB at the moment and I have over 2 million records (Excel only reads 1.1 million records).

What can I do?

Thank's to everyone!

[danilang]

Hi @sebenciven 

The solution here is to read the existing rows from the csv file, append your new data to this and overwrite the existing file

Dan

[sebenciven]

@danilang thanks, but I would like to keep the table historicization and not overwrite the file in any way.
Is this possible in your opinion?

[danilang]

Hi @sebenciven 

Even if the Input Tool did allow you to append, the last modified timestamp would still change.  By comparing the last modified with the created date you can show that the file was changed but there's no way see what changed.   

If you're familiar with python, you can pass the new data to a python tool, open the file with the "a" access modifier which will allow you to append to the existing file. 

Dan  

[kamal03]

Hi @sebenciven 

To handle large data in Alteryx beyond Excel's limits, install a local SQL Server (it's free). Create a table in it to store all your data. Configure Alteryx to keep adding new data to this table. This way, you can easily manage and process large datasets using SQL within Alteryx.

Let me know if your requirement is something different.