Selective Loading of Files Using the Files Loader

[Kosi]

Currently, the Files Loader in Connect loads all files in a directory regardless of whether they are used in an asset (e.g Alteryx workflow, Tableau dashboard, etc). This becomes a problem when you have folders containing hundreds or even thousands of files that may not actually be linked in anyway to Alteryx or Tableau as those are all populated into Connect.

It would be beneficial if the Files loader was more selective about what files to load into the Connect UI by picking up file relationships discovered using the Alteryx and Tableau loaders for example.

[VojtechT]

Hi @Kosi 

I understand the use case, however your proposed solution would require to do some sort of comparison of what the loader finds on drive vs. what the loader finds as referenced by workflows. Or even other assets, e.g. reports.

We are working on different approach that when a workflow references a file, we not only show such information (as we are doing already), but we also create such object as if it would have been created by e.g. filesystem loader. 

That means that all, but also only, objects that are used in any workflow are created in Connect directly as asset. 

Would this solution serve the purpose of your use case?

[Kosi]

Hi Vojta, Apologies for the delay. Yes that would work! Ultimately just looking for a way to bypass the loading of each different folder which may contain multiple files that are not actually used in any workflows either. Would this method then not require the use of the file loaders at all?

[KylieF]

This idea is being updated to Coming Soon as a feature that assists with only loading folders which impact the workflow and excluding folders and files that do not will be available in a near future release.

[KylieF]

Thanks for suggesting this idea!

Our product team is excited to say we have implemented selective loading of files in the 2020.4 release of Connect which is available for download here!