Increase Field Size on Initial Input or Merge Initial Records into larger Chunks

hellyars

Hi,

BACKGROUND...

I have a very large flat text file (HTML).  The text is minified, so 85,000 plus records are trapped in one line.  I am trying to bring it into Alteryx. 

INPUT TOOL SETUP

I have the Input Tool set to "Read it as a fixed width text file".   EOL is set to None.   Record Length is set to 6500.  Field Type is set to V_String.  This results in 4,195 records that I assume are confined by the Length of 6500.

NEXT STEP

I can then use the Text To Columns tool to break the lines into individual records using a pipe "|" I added after the end of each closing table row tag before bringing the data into Alteryx.  

PROBLEM

The initial 4,195 records stop at 6500 characters.  They do not necessarily terminate nicely at the end of a table row.  They may terminate mid-stream.  This results in a few thousand broken records. (LOL)

QUESTION:

Is there any way to increase the initial Length to greater than 6500?  ALTERNATIVELY, is there a way to merge these initial 4,195 records into larger chunks with a much higher size?

hellyars

I had to find a text editor that could handle a 120MB minified file.  Neither Sublime Text or ATOM worked.  UltraEdit worked.  Added a \n after each </tr>.  Deleted unnecessary html tags, and replaced others with a delimiter to allow split rows into columns.