Advent of Code is back! Unwrap daily challenges to sharpen your Alteryx skills and earn badges along the way! Learn more now.

Alteryx Designer Desktop Discussions

Find answers, ask questions, and share expertise about Alteryx Designer Desktop and Intelligence Suite.

How to import huge txt file with comma delimiter and new line delimiter vertical bar?

slobo
8 - Asteroid

I'm having issue with importing huge txt file where delimiter is comma and there is also newline delimiter which is vertical bar.

 

I've tried to import with \0 delimiter so I could separate everything after with Text to tool but the error I'm receiving is that Input tool is unable to import because number of fields is greater than 16M fields. 

 

What could I do? Thanks.

12 REPLIES 12
Raj
16 - Nebula

can you share the file

slobo
8 - Asteroid

Sorry, no. Sensitive data.

Raj
16 - Nebula

ok, can you create one which is not sensitive and can be shared

slobo
8 - Asteroid

I've shared the file, sample data. 

binuacs
21 - Polaris

@slobo One way of doing this

 

binuacs_0-1674209020305.png

 

slobo
8 - Asteroid

I cannot open your workflow package, it says it may be because of yours newer version of Alteryx. Thanks

Raj
16 - Nebula

First split to rows using "|" as a delimiter

second split to the column using "," as a delimiter

then use dynamic rename to make the first row as header

binuacs
21 - Polaris

@slobo Open the workflow in a notepad++ and change the version and save it, then you will be able to open it in your alteryx designer

 

binuacs_0-1674213630051.png

 

binuacs
21 - Polaris

@slobo below is the input file configuration

 

binuacs_1-1674213712389.png

 

Labels