Alteryx Designer Discussions

Find answers, ask questions, and share expertise about Alteryx Designer.

'Tis the season to be spooky! Read our new blog, How Spooky is Your City? Mapping and Predicting Scary Stuff. In it, @SusanCS provides a fun glimpse into using data to figure out the creepy quotient of where you live!

Separating Large Dataset

Highlighted
7 - Meteor

I'm regularly given deployment lists that are way too big to upload into our email client as a whole. These lists are like 900,000 rows of data that I need to separate into smaller equal parts. Is there a way I can tell alteryx to see what the max number of records in the list is and split it into even datasets that are more manageable, but also maintain the fields at the top?

Highlighted
14 - Magnetar

Hi,

I'm assuming here you are referencing sending out multiple emails, or multiple files?

You can very easily accomplish something like this using the Group By functionality in Alteryx, or by creating file names or email names and leveraging these in your output, but understanding your final end point will help a lot in creating an example of this.

Highlighted
7 - Meteor

Hi Claje,

 

I need to separate a larger list file into smaller files for import.

 

 

Highlighted
14 - Magnetar

Here's an example workflow splitting a list of 900,000 records into individual files (split every 3000 records).  I used the Multi-Row Formula tool to accomplish the naming convention easily, and then output to a series of temp csv files.  Does this do what you are looking for?

Highlighted
7 - Meteor

Yes thank you Claje!

Highlighted
6 - Meteoroid

Wow! I'm glad I came across this! I have to separate a file every 3,000 records as well. One additional requirement is I need to separate files by State Code as well. So I might have 12 Files for "CA" with 3,000 records in each and I would have maybe 8 Files for "AZ". Mostly likely the last file for each state will have less than 3,000 records. So I would have 2 control breaks: State Code and 3,000 record requirement. Any thoughts you could share that would be helpful?

Labels