Dynamic input not pulling through all the files

[Michielvandermerwe]

I have build a tool to dynamically fetch all the data in a specified directory so all the file in the directory is from the first of the month but it is only pulling data in, up and including the 27 of the month. Can someone please advise on why this is happening? 

[danilang]

Hi @Michielvandermerwe 

Are you getting any warning messages about certain files being skipped because of different schemas?  Or any other warning messages for that matter?

Dan

[Michielvandermerwe · Accepted solution]

@danilang  Yes I did get warnings, but I manage to see that those files that are being skipped have more columns than the other files once I removed the extra columns it managed to work thanks so much for the effort of replying.