Search and curate large database

[creily]

Hello,

I have a large matrix that I am working with (~5.5GB), and I need to search through it and pull out specific columns. The database looks like the following:

Gene    Cell-ID1   Cell-ID2   Cell-ID3 ....Cell-ID34,766

1            -.00045   0.1702.    -.005

2

3

...

21,668

I am having trouble figuring out how to move column to column to find if a gene meets a certain numerical level, and then pulling out the column if it does. Thanks.

[OldDogNewTricks · Accepted solution]

I think you may mean something like this:

Read data in, transpose it, search for values.  Workflow attached.

Results of true part of workflow result:

[creily]

This worked great! Thanks for the help.