connect to hadoop unix side from alteryx

[sid]

How do we use alteryx command tool to connect to hadoop unix side and get the hadoop environment variables? the requirement is that we would like to access the hadoop cluster based on the environment and pull the pertinent database connection info.. we have 3 servers one for DEV,QA and PROD. We dont want to change the config file everytime we deploy to a new environment.

[PamW · Accepted solution]

I am going to do a lot of pointing you around here and there for the answer but here it is....

You can connect to a unix system from a windows system and run a command using SSH. 

http://stackoverflow.com/questions/6147203/automating-running-command-on-linux-from-windows-using-pu...

In Alteryx Designer you can use the run command tool to excecute the above from the command line or put the above in a batch, power shell, python, etc script  that write results to a file. As an input to the run command you will read the results file into alteryx and likely have to parse it into fields and do some processing.

To make the input configuration dynamic you will put the Input Data tool in a Batch Macro. Configure the control parameter to update the input data tool, there is a good article here that has an example of updating an Input Data tool in a batch macro. @AlexK may be able to provide additional Input Data tool examples for Batch Macros.

If you have questions i can send you an example using HDP Sandbox.

[sid]

Thanks Pam for the detailed explanation. let me work on it from my side . i think i got the idea of how to do it.. 

[AngelaO]

The Run Command: Write Source & Read Results

http://community.alteryx.com/t5/Alteryx-Knowledge-Base/The-Run-Command-Write-Source-amp-Read-Results...