i am running a workflow that uses a 1GB sas7bdat file and the workflow only has a few tiles,sort and unique tools, but the swap files created (temp files) are more than 500 and those seems to be 1GB of size, has anyone face this issue? Any suggestions to avoid getting the disk space full?
Is it possible to use macros to reduce the generation on temp swap files generated during the workflow execution? Thanks for the suggestions
Hi @Gibranscrw, yes, this is a known issue when working with large files and workflows that generate many temporary swap files, which can quickly consume disk space. Here are some suggestions to help reduce the temp file usage and avoid filling your disk:
Hi Ignacio thanks for the reply, I have done all the procedures except the one of splitting the dataset I to chunks and I still getting the disk space full, however it seems that the workflow is accumulating the number of swap files to generate as the error showed like 15 swap files that were not able to be generated and now it is showing 12000 swap files. I am only ingesting 1 GB dataset to the workflow and I have multiple macros a just a few tiles, sort and unique tools which could related to generating temp files.
I also noticed that when I use alteryx the formula tool set a string size of 1073741823 and if I add a text input tool before that formula tool with just one record and the number one as a v_string the string size changes to 2147483647. I remember creating the same set of tools in a workflow and the string size displayed would be 255. Is there any issue with my alteryx designer? I am using Alteryx 2024.1.1.178 patch 6.