Restrict the row generated by Directory

Hello All,

Is there a way to restrict the rows generated by a DIRECTORY tool. I have a path that holds folder from 2018 for every single day like 20180101, 20180102....20200604.

whenever I run the workflow, it takes 24 minutes to read all these files and produce rows info. How can I restrict the no of rows read by the directory to read-only folders from 20200101 onwards and ignore other folders.

Best Regards

Ankur Tyagi

Developer

Developer Tools

Settings

Tips and Tricks

Transformation

Accepted answers

DavidP

Here's an example where the folder path ends in a date folder with format yyyymmdd

The workflow replaces that date with today's date that then dynamically changes the folder path in the macro.

Dynamic directory tool.yxmd

DavidP

So from the pic below, you can see that in the macro, I set the Directory tool up with some placeholder information:

1. Folder path is C:\Users\david\Documents\Alteryx\Diectory tool test folder

2. File Specification is RTL_SAP_SD1_INVENTORY_BALANCES_DAILY_01282020_*

With the 2 control parameters and action tools, I then tell the macro to update these values at runtime as follows:

1. Replace the entire folder path with the value of the field that is picked for the Folder Path question

2. Replace DAILY_01282020 with the value of the field that is picked for the File Specification question

Then in the workflow, I specified the folder path in the Text Input tool and used the DatetimeNow tool to retrieve today's date and then convert it to the format DAILY_mmddyyyy

You'll see in my last post that I modified the workflow so that the Folder Path ends in a date folder of the format \yyyymmdd and then use a formula to replace that date with today's date in the same format. Now when the workflow is run, it will only search in the path with today's date folder.

Now that you're only looking at the files in today's folder, you can probably change the File Specification in the Directory tool inside the macro to *.* and remove the control parameter and action tool on the right that updates the File Specification.

Remember to save the changes in the macro if you do this. You can then simplify the workflow and remove the DatetimeNow, Select, Formula and Append fields tools and simply keep the Text Input and Formula tools to feed the Macro.

All comments

DavidP

I'm wondering if you can put the Directory tool inside a Batch Macro and update the File specification filter via the Control Parameter.

You can specify the exact filename with date and then replace the date with a list of valid dates from your control parameter.

ankurrjit

Hi @DavidP Thanks for the suggestion. I tried to give it in this way as below snapshot but it is not working, am I doing something wrong.?

Quick Links

This months top contributors

atcodedog05 19458

Qiu 15866

binu_acs 15708

MarqueeCrew 13708

apathetichell 13703