Selecting columns from imported data, based on a list of desired columns

[mric]

Alteryx rookie here! Just started using the tool and am amazed at its power already!

I have a huge data set with over 500 columns, of which I only really need 30 or so for my analysis. Instead of using the select tool and manually scrolling through 500 fields to choose the 30 I need, I was wondering if there is a way to use a list of the 30 columns from a separate excel file, and then use this list in combination with the select tool.

This may be an easy question - forgive me! 🙂

Thanks!

[andyuttley]

Hi @mric 

One method is to list the fields out that you'd want (e.g. in a text input); if you transpose your data, you can use a join as a 'select', where the middle of the join (field name to name, shown below) becomes the fields you want. 

To get your data back to where you want you just need to cross tab back. Something along the lines of this (and attached):

Hope that helps

Andy 

[jrgo]

@mric 

A Union tool, I think, would fit the bill. There's an option that's often overlooked that will only output fields that existed in all the data streams connected into it.

Hope this helps!

Jimmy
Teknion Data Solutions

[mric]

Thanks very much Jimmy! Appreciate the quick reply. Wishing you a productive week!

[mric]

Thanks a lot Andy for this analysis and workflow. Happy Monday!

[PhilipMannering]

I'd use the dynamic tools to do this,

wf

[chineeloh]

@PhilipMannering works like a charm, incredibly useful tip.

Thank you for sharing this solution! Should be marked as SOLVED!

Cheers,

Chinee

[ssjl]

I know this thread is old but this saved me LOADS of work today and I am very grateful! 

[madhurinani]

@PhilipMannering :

Quick question, what if the column header are dynamically changing?

I have column that have names such as Debit from abc, debit from xyz, debit from qwe etc

I would like to filter those columns, but I cant add to the list as the header keeps on changing each month, right?

any solution that you could suggest?

Thanks!

[PhilipMannering]

Does it always start with "Debit from"? If so, then it's easy enough to use the Dynamic Select Tool with a formula `Startswith([Name], 'Debit from')`

Either way, you'll need some logic to identify the columns you want to keep to automate it, right?