Community Spring Cleaning week is here! Join your fellow Maveryx in digging through your old posts and marking comments on them as solved. Learn more here!

Alteryx Server Discussions

Find answers, ask questions, and share expertise about Alteryx Server.

Alteryx — Design for Enterprise level Logging and Altering

DeepakTyagi
8 - Asteroid

Like with any system the essence of debugging lies in how meaningful the logs are and Alteryx workflows are no exception. For enterprise systems using Alteryx three main aspects have to be paid attention to :

  1. What information to log and how
  2. How to access it
  3. Who should be alerted

What information to log and how

Answer to what is pretty straightforward, it should be what will help you identify the root cause. During the workflow execution, Alteryx will itself generate tool id, start-and-end message, and standard information generated by the tool like SQL executed by the Input tool, etc. Besides this, you can utilize the Message tool to create custom messages that will become part of the log. The Message Tool can be set up to pick up records before, during, and after the records have passed through the tool itself. This makes it useful for evaluating your dataset at different parts of your workflow.

DeepakTyagi_0-1625248679514.png

 

DeepakTyagi_1-1625248679546.png

 

How to access it

On the Alteryx server, there are two types of logs generated :

  1. Server (Engine) logs
  2. Workflow execution logs

Server logs contain information about the Alteryx runtime environment and are meaningful to the people supporting the Alteryx service (DevOps).

Workflow execution contains information on the processing of the business logic, data transformation, and interaction with input/output data sources. This is meaningful to the Business users and DevOps team.

As the two data sets cater to a different user base they should be persisted separately. The most common tool available in the market is Splunk, which can house this data set in two different indices with specific permissions.

DeepakTyagi_2-1625248679526.png

 

DeepakTyagi_3-1625248679728.png

 

Who should be Alerted

Apart from making the information available in Splunk, there is a need to alert Business users and/or DevOps team in case of specific events. These events could be categorized into two broad categories

  1. Business events — these include failures due to incorrect data type, business calculation, etc. which Business users should know so that they know the cause of failure and can take corrective action.
  2. Events related to interfacing systems — these cover unavailability of feeds, databases, API services, etc. which DevOps team should be notified for followup

As both the events need immediate attention, they are best served by an email alert and can be set up using the Workflow “Events”. This is found under “Events” in the workflow configuration panel.

DeepakTyagi_4-1625248679622.png

 

DeepakTyagi_5-1625248679656.png

 

DeepakTyagi_6-1625248679647.png

 

DeepakTyagi_7-1625248679697.png

 

In this way, you achieve the following:

  1. Provide self-service log review capability to Business users
  2. Separate out service and workflow related information
  3. Create an immutable source of logs using Splunk for audit
  4. Generate alerts for Business and Service events
2 REPLIES 2
joshuaburkhow
ACE Emeritus
ACE Emeritus

There are actually more than just 2 😉 Gallery Logs. AAS Logs as well 😁

Joshua Burkhow - Alteryx Ace | Global Alteryx Architect @PwC | Blogger @ AlterTricks
DeepakTyagi
8 - Asteroid

you are correct, point i am elaborating is you can separate out the logs so that concerned parties get the information they need. If I am not mistaken aas logs get created only when you have SAML based authentication. If you have windows integrated solution then I have not seen them being generated