Internal Error: Tool 13 is reporting again that it is 'complete'

[VinayakS]

Hi ,
Please help me to resolve below errors I am getting in Alteryx workflow

Join (13)  : Internal Error: Tool 13 is reporting again that it is 'complete'

Join (18)  : Internal Error: Tool 18 is reporting again that it is 'complete'

Unique (20)  : Internal Error: Tool 20 is reporting again that it is 'complete'

[binuacs]

@VinayakS Would you be able to give more information about the error? If possible attach the workflow

[VinayakS]

@binuacs  I am processing large number of data set and connecting everything to DB so is there any chance we are facing the issue because of that if I process any small set of data with same workflow not getting any error and it is completing properly is there anything where we can do anything with data so that will get the same result is there any option

[VinayakS]

This is the workflow

[binuacs]

@VinayakS Since the source is DB I couldn't do any testing on this workflow. One option I am thinking to switch off the AMP engine and run the workflow

[jdminton]

@VinayakS Looking at the workflow, the error is coming in the Brand + Formulation checks container. I plugged in some fake data, but as you mentioned, the smaller data sets don't seem to cause an error. I would look at the data after the transpose that starts that container and see if there is any data that might be causing an issue (nulls, unusual values, etc.). You also might want to look at the data coming into the join (left and right) to see if data there might be causing an issue. The error would indicate a loop is being created, but I don't see that in the workflow, so if it is looping, it must somehow be associated with the data. Possibly the AMP engine is causing it as @binuacs suggested. Let us know if turning that off helps. That can be turned off directly in the workflow itself though (see bottom image)

 

 

[VinayakS]

Hi @binuacs & @jdminton Thanks a lot for your help, 
by deselecting "Use AMP engine" we can able to generate the data and also the internal error is not coming now but one output file is showing 

"Number of records exceeds the excel maximum (1048576).No records were written." how to split the data in different output file

[caltang]

You can set an excel limit and can determine where to split it by row to the next file in the output. Or you can use a RecordID to set the limit that you know so that you can filter them out into separate outputs with Block Until Done as well.

[jdminton]

@VinayakS take a look at the number of records going into the left and right for that join and the number of records coming out. Add a select tool after the left and right outputs, change connection progress to "Show" (see below). After you run again, grab a screenshot and share that. My guess is that the join might be creating duplicates.

 

If you're sure it's not creating duplicates, you could change the outputs in your data errors output container to add an additional filter on the false side.

 

Although it would make more sense to create a formula to break it up versus filters. You can do this with an existing field if it makes sense. Otherwise, you can create a field to break up your data. I used the formula tool to make a field that allows for just one output tool:

 

 

This will create a field that breaks the data up into 250,000 rows each before outputting to Excel. use the formula and output instead of the filter and output you currently use.

 

 

[binuacs]

@VinayakS Another way of splitting the records into equal records and writing into different sheets on the same excel