"Parse Error at char (n): Unknown variable..." Macro Error, No Error Workflow

Hello,

I am confused what I'm doing wrong that would cause an error when converting a workflow to a batch macro.

I have a workflow that produces the expected results without errors:

I've converted the workflow to a batch macro. When I call the batch macro it can't find the field "member", however in the previous screen shot member is defined and there are no issues with the formula tool #33. What would be causing this error message?

Cheers

Developer

Macros

Accepted answers

DataNath

I think this would be best done by another batch macro, where you pass a list of eligible filepaths to the filter via a control parameter and then within that they run through the other. That way, the macro will run an instance for each of the filepaths without you having to add extra filters or do a load of runs, changing the filter value each time.

All comments

gabrielvilella

Does the file that you are reading when testing the macro has the member field? I know that the one you have within the macro has it.

DataNath

If you go to the second, 'Questions' window of your batch macro configuration window, you may just need to map it there to make sure the macro is referencing the right field from the input (i.e. if you build the macro with one field and in your live data it's named differently or something):

To enable field mapping, just click on your macro input and make sure it's ticked here (Show field map):

joesparty

Yes the same file is used in both, therefore the 'member' field is there.

joesparty

@DataNath I'm using a directory tool to send FullPath field to the macro to loop.

gabrielvilella

Are you able to share the macro and sample data?

DataNath

As you're looping through filepaths, is there a chance that this member field is named differently in some files?

joesparty

The issue could be my inexperience with Alteryx and macros. I was using the DIR tool to list all files in subfolders, there are 15 files in each subfolder. When passing the FilePath to the macro my thought was that the input tool would only use the same file that matches. I think it was trying to process all 15 files in each subfolder, which means the 'member' field is not in all 15 files and therefore the error.

Thoughts?

DataNath

Yes that'll definitely be the cause of the issue @joesparty. You can read in multiple files with different schema, there's a great article on doing so here:

https://community.alteryx.com/t5/Alteryx-Designer-Knowledge-Base/CS-Macro-Dev-Reading-in-Multiple-Files-with-Different-Field/ta-p/13370

After this, you could perhaps add a filter that will remove everything where the [member] field is null, before continuing on down stream as you wish.

joesparty

@DataNath thanks for the confirmation and link. How can I pass/filter multiple files if the input macro accepts one input?

In the screen shot below I was able to pass "File 1" filter to the macro and it worked. File 1 has 4 fields that need to be appended to File 2 in the macro. I can't pass "File 2" filter to the macro.

Here is the view of the macro where File 1 works. I want to process File 2, then append fields from File 1.

DataNath

@joesparty I'd try putting these filters inside the macro so there's a check that, if the member field is there and there's the same amount of fields as expected then it Outputs from the macro, if not it just does nothing - then when all iterations are completed the Batch macro should just append all of the successful results together automatically by name if you've selected that option.

joesparty

@DataNath agree with moving these filters inside the macro, but is that possible with; control parameter, action, input? I wasn't able to connect the filter tool.

DataNath

No you won't be able to place a filter there. I was thinking you could place it just before the macro output so that if the file is there and passes through alright it'll output and be appended to the others, if not it'd be discarded (not output to anything).

joesparty

@DataNath apologies, I'm lost!

I had a filter for a specific file before the macro.
I think your suggestion was to place it inside the macro, correct?
The filter is used to select the correct file for the input tool, how can I place the filter before the macro output? My thought is the macro would fail because it would be trying to pass 15 files (in each subfolder) vs. the one I'm trying to filter on.

DataNath

What exactly is your macro doing @joesparty? With you initially saying you wanted to loop through filepaths, I thought you meant you wanted to do this and just have a consolidated dataset of all suitable files. This is why I suggested using a Filter just before the output to only output suitable files from the macro. However, if you know what files you want to process then the approach will be different.

joesparty

@DataNath I am trying to get the macro to:

get a list of folders, currently 40 folders with 15 files
loop through each folder and process 8 of the 15 files
create a results file for each kpi

Knowing the exact files to process how would apprach it?

DataNath

Do the target files have anything special like named differently or have a unique way of setting them apart? Failing that, I can think of a method using the Field Info tool to check if each file contains the [member] field and, if not, exclude them with a filter before feeding them to your control parameter. This would perhaps need to be a nested batch macro though.

joesparty

There are specific file names as a unique way of setting them apart.

DataNath

Ok @joesparty, in that case, after the initial Directory tool, you can just filter based on whatever that unique identifier is - that way everything that comes out of the true anchor should be these suitable files and feed into your batch macro fine.

joesparty

@DataNath agree with the approach. The issue is I can only pass 1 filter to the macro. I have to pass 8 files, won't the macro still fail because the input tool is not looking for a specific file name? So Input File 1 would work when passing File 1, but fail on File 2.

DataNath

@joesparty as you’re passing the filepath to the control parameter, this will run a loop of the macro for each of your filepaths i.e. bringing in one at a time so it should work.

joesparty

@DataNath is there a way to pass multiple filepaths to different control parameters?

DataNath

What would be the purpose? You can have the stream going to as many control parameter/macros as you like. I thought the purpose was to run all suitable files through and append them together but maybe I’ve misunderstood.

joesparty

@DataNath I appreciate your time and feedback, so I'll try to give a visual example of the issue.

In the screen shot I have a filter for 1 of the 8 files to process
In the screen shot this workflow is using the File 1 Fullpath, the Input Data imports only File 1. This works as expected.
How do I pass a filter for File 2 to the macro so that the Input Data imports only File 2, not File 1, 3-8?

DataNath

joesparty

Great, will give it a try!

Quick Links

This months top contributors

atcodedog05 19598

Qiu 15867

binu_acs 15708

MarqueeCrew 13708

apathetichell 13703