Conditional Join for Input files

I have 2 input files that are rather large. The 1st file contains 2019 data and the other contains data for 2020-2021. I have the user inputting what time frame they are looking for but that is done as a filter after the join between the 2 files occur. My question is if I can put in a condition that if the user is only looking at 2020 dates, is there a way for the input file/join to ignore the 2019 file? Since these are large files, it takes a little bit for the workflow to complete so my thought was that if the 2019 file wasn't needed, that would speed up the process.

Workflow

Input

Join

Accepted answers

atcodedog05

Hi @JCornacchia

Since now i have a better idea of what you are looking for that you do not want read 2019 if its not selected. Here is what you can do.

workflow:

1. You can add 2019 input tool to a container.

2. Using condition tool i am pluging-in in values from start date & end date and checking them. If neither of them contains 2019 i am collapsing the container (i,e input tool wont run). If either of them have 2019 it will stay active and run.

Hope this helps 🙂

Example.yxwz

All comments

mceleavey

Hi @JCornacchia ,

Yes, you can use the interface tools to populate the selection if you don't want them opening the workflow, however you can continue with the filter if that's good enough for what you want.

We can build this for you if you post some mock data and your workflow.

JCornacchia

Attached is an example of the beginning portion of my workflow. So the user inputs the start/end dates and I would like the condition to be if 2019 in either of the inputs, then complete the union, if not just use the 2020_2021 input file. I am using the filter now but these files are large so if there's a way that this would speed up the workflow, that would be ideal.

Example.yxzp

Quick Links

This months top contributors

atcodedog05 19458

Qiu 15866

binu_acs 15708

MarqueeCrew 13708

apathetichell 13703