Data being lost because of truncation

Question

Hi,

I am doing some work in CSV file and contains huge amount of data. but because of truncation i seen that some of the data is being lost so after referring to many posts i increased the field limit and the truncation problem was solved but still i am not able to see the complete data in a particular column. When i attached a browse tool i can see the result completely in that particular column. but without getting the whole data i cannot move on with further processing. is there anyway to solve this?

thanks in advance

DawnDuong · Answer

hi @Govind_Dileep_G

Just to make sure that I correctly understand the problem you are facing: you need to have full visibility of all data in all columns in every intermediary step to decide how to further process the downstream data.

There is a simple, but not so elegant, solution of including browse tool after every key step.

Not so elegant because having many browse tools can slow performance a lot if you are handling a large amount of data. if your data is <100MB should not be too badly affected.

Note that there is a limit of 300MB as disclosed in Alteryx Help document. https://help.alteryx.com/20213/designer/browse-tool

Regardless of whether the data is completely displayed, all data should be processed (subject to hardware limitations) and is not "lost".

Dawn.

binay2448 · Answer

Browse tool will display all the records but other tools may not.

It will only display some sample records from the top.

But you can take output for all the records or apply further calculation on same, it will work.

cmcclellan · Answer

If you can see it in a Browse tool it's not really a problem, the results pane won't show the entire field when it's really big (text or numbers)