Removing old data from yxdb

sk1909

I have a yxdb file that has been building for 4 years now. How do I remove the older data without losing the integrity of the yxdb? Is there a basic workflow I can create to do this?

I've attached a sample of the yxdb in an excel file. I only want to keep 2019 and 2020 data that focuses on the LAST_UPDATE_DATE column.

The workflow I have uses yesterday's date and says pull everything after this date so it's just compounding new data to the old yxdb so I'm not worried about that piece. I just don't want to break anything but I really need to speed up this workflow and this is a HUGE part of it. If I can reduce the size of the 5 yxdb files, instead of it taking 8-10 hours to run, I can get it done in 3-5 hours.

Thanks to anyone willing to help!

Sheila

SK_YXDB_Sample.xlsx

Help

Optimization

Accepted answers

Emil_Kos

Hi @sk1909,

If I understood correctly you should use a simple filter tool. I would advise creating a backup copy of a file before you will do the operation just to make sure that you are safe.

Hope it helps.

Filter.yxmd

All comments

Emil_Kos

Hi @sk1909,

If I understood correctly you should use a simple filter tool. I would advise creating a backup copy of a file before you will do the operation just to make sure that you are safe.

Hope it helps.

Filter.yxmd

ChrisTX

After the filter, you may want to use a Block until Done, then use an Output tool to overwrite the YXDB file.

sk1909

I'm going to try this now. I've already created a duplicate of the yxdb file to practice on. Thank you!

sk1909

This worked! I reduced my file size successfully. I need to reduce it some more though so I'm also dropping 2019 with the same process. Thank you!

Quick Links

This months top contributors

atcodedog05 19598

Qiu 15867

binu_acs 15708

MarqueeCrew 13708

apathetichell 13703