How to loop through files in batches?

Question

I have a project where I need to loop through sets of files based on their dates in a directory. Here's how my directory will look like.

First File 12-20-2021

Second File 12-19-2021

Third File 12-20-2021

Fourth File 12-20-2021

First File 12-14-2021

Second File 12-13-2021

Third File 12-14-2021

Fourth File 12-14-2021

etc...

First and Second files all have the same schema, Third and Fourth have different schemas.

I am thinking that I can use the directory tool to get all the First Files in the directory and then regex the dates. I would then need to loop through all of the dates and process the files in batches.I am not sure how to do this in the designer though. I would imagine I would have to feed the date to a macro that then goes to the directory and opens the first/second files and combines their data for processing? Then another macro would get the same date and open the third file for separate processing as well as for the Fourth file I guess I would need a different macro?

Sorry if this is confusing, I am trying to figure out how to process these four files together and then move on to the next set of files in the most efficient way possible. I'm new to macros 😞

Qiu · Answer

@Mond 
Sorry I can not tell what is the error exactly. Maybe the version?
Can you upgrade your alteryx to the latest one?

Anyway, I am uploading the files again.

Dynamic Multi File Sheet Names.yxmc

Multi Sheet Import Example 2.yxmd

Import Multiple Schema Flat Files.yxmc

Mond · Answer

thanks for sharing but for reason i'm getting an error to import the workflow.

Failure to Import C:\Users\LO\Downloads\Multi Sheet Import Example 2.yxzp.
There was an error opening "C:\Users\LO\Downloads\Multi Sheet Import Example 2\Multi Sheet Import Example 2.yxmd":

Qiu · Answer

@Mond 
I believe you are describing a classic importing Excel sheets/files with different schema.

There is an existing macro here  which can be used for your case.
If you can provide some sample datasets, i can try to modify it to suit your purpose.

Multi Sheet Import Example 2.yxzp