topic Re: connect to hadoop unix side from alteryx in Alteryx Server Discussions

connect to hadoop unix side from alteryx

sid — Thu, 24 May 2018 01:10:30 GMT

How do we use alteryx command tool to connect to hadoop unix side and get the hadoop environment variables? the requirement is that we would like to access the hadoop cluster based on the environment and pull the pertinent database connection info.. we have 3 servers one for DEV,QA and PROD. We dont want to change the config file everytime we deploy to a new environment.

Re: connect to hadoop unix side from alteryx

PamW — Thu, 21 Jul 2016 19:44:03 GMT

I am going to do a lot of pointing you around here and there for the answer but here it is....

You can connect to a unix system from a windows system and run a command using SSH.

http://stackoverflow.com/questions/6147203/automating-running-command-on-linux-from-windows-using-putty

In Alteryx Designer you can use the run command tool to excecute the above from the command line or put the above in a batch, power shell, python, etc script that write results to a file. As an input to the run command you will read the results file into alteryx and likely have to parse it into fields and do some processing.

To make the input configuration dynamic you will put the Input Data tool in a Batch Macro. Configure the control parameter to update the input data tool, there is a good article here that has an example of updating an Input Data tool in a batch macro. @AlexK may be able to provide additional Input Data tool examples for Batch Macros.

If you have questions i can send you an example using HDP Sandbox.

Re: connect to hadoop unix side from alteryx

sid — Fri, 22 Jul 2016 13:19:00 GMT

Thanks Pam for the detailed explanation. let me work on it from my side . i think i got the idea of how to do it..

Re: connect to hadoop unix side from alteryx

AngelaO — Tue, 26 Jul 2016 12:48:35 GMT

The Run Command: Write Source & Read Results

http://community.alteryx.com/t5/Alteryx-Knowledge-Base/The-Run-Command-Write-Source-amp-Read-Results/ta-p/15723