How to validate and control what is new?

Hi

As concept, I do a run where I consolidate excel files into a alteryx database.

I have
01.2021.GLS.xlsx

02.2021 GLS.xlsx

03.2021 GLS.xlsx

04.2021 GLS.xlsx

05.2021 GLS.xlsx

and so on. I want to add LastWriteTime for the .xlsx files

so when i consolidate them into 2021 GLS.yxdb my consolidation flow only take changed files.

So basicly when I do my consolidating I want to look up what has a LastWriteTime newer than lasttime I did my run, and only consolidate these?

GLS 2021.yxdb

Batch Macro

Accepted answers

atcodedog05

Hi @Hamder83

Here is the updated solution you can find and replace tool to map the previous LastWriteTime to check whether current LastWriteTime is greater than previous LastWriteTime

Workflow:

Hope this helps : )

LastWrite.yxmd

All comments

vsoni

i would use a filter where DateTimeNow() is greater than the lastWriteTime, and then a dynamic input to import only those files.

Hamder83

Hi @vsoni

The alteryx db i attached should be a simpyfied version of my consolidated file.

And I want to base my load of excel files based of the lastwritetime in the previous output file.

So I was thinking I needed to include it to get the lastwritetime from the previous run.

But I dont know how to filter them out, using the dynamic input file?

atcodedog05

Hi @Hamder83

Use the directory tool to get the files info which you would also give to LastWriteTime. You can apply to check if LastWriteTime is greater than the start of today (you can implement any kind of check for LastWriteTime). Use dynamic input tool to read only those files and you can also map the LastWriteTime in data by taking Filename as refrence. Refer below

Workflow:

Hope this helps : )

LastWrite.yxmd

atcodedog05

Hi @Hamder83

Here is the updated solution you can find and replace tool to map the previous LastWriteTime to check whether current LastWriteTime is greater than previous LastWriteTime

Workflow:

Hope this helps : )

LastWrite.yxmd

Quick Links

This months top contributors

atcodedog05 19458

Qiu 15866

binu_acs 15708

MarqueeCrew 13708

apathetichell 13703