Azure Data Lake Tools Dynamic File Naming

Michael1974

Hi,

We recently installed the Azure Datalake Tools so we could send files to our Storage Account.

Is there a way we can rename the filepath dynamically - for example append a date onto the filename?

Unlike the standard output tool there doesnt seem an obvious solution.

Any advice would be greatly appreciated

Thanks

Workflow

Output

Connectors

Accepted answers

All comments

Michael1974

Im exploring ways to use a macro to achieve this, seems to work ok but would still appreciate any other suggestions

VojtechT

Hi @Michael1974 , could you please just confirm that I understand the use case correctly - you would like to set the filename according to a field instead of statically configuring the filename in the connector, correct?

so instead of saying the filename is "output.json" you'd rather select "filename" field to express that the filename comes from the data. Is that so?

Michael1974

Yes thats correct .

So the current workaround we put together puts the connector in a macro, then in the main workflow we pass the dynamic filename into the macro.

VojtechT

Do you happen to have an access to OneDrive or SharePoint or Dropbox or Box? There are connectors for those where such feature is already implemented, so you can test it out to make sure it fulfils your use case.

Michael1974

Hi Vojta, I dont, our firewalls are pretty tough on using those for receipt of files.

We only just downloaded the connectors, I didnt see anything newer available. Would it work in 2020.2? also i note that in the connectors we are using we can only send csv as coma delim. is pipe delim an option also?

Thanks again

LeandraWR

Hi Michael

Would you be able to share how you did this using a macro?
We are trying to do the same but not having luck.

oliviervandyck

also curious to see this workflow !

Quick Links

This months top contributors

atcodedog05 19598

Qiu 15867

binu_acs 15708

MarqueeCrew 13708

apathetichell 13703